1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Is Robots.txt better than Robots in META?

Discussion in 'robots.txt' started by Woodcs82, Jun 10, 2010.

  1. seochain

    seochain Peon

    Messages:
    9
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #21
    Hi
    How to use robots.txt file in wordpress. Anyone help me pls?
     
    seochain, Aug 23, 2010 IP
  2. seo.raj

    seo.raj Active Member

    Messages:
    273
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    71
    #22
    What the use of robot.txt file. robot.txt file used to avoid index or crawl by Google some unused pages.by default robot.txt all page allow. If you want not crawl by crawler than you can use robot.txt. file and disallow it.
     
    seo.raj, Aug 26, 2010 IP
  3. seo.lover

    seo.lover Peon

    Messages:
    132
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #23
    thanks buddy, thank you very much for sharing this nice info
     
    seo.lover, Aug 29, 2010 IP
  4. techvivek

    techvivek Peon

    Messages:
    24
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #24
    you can use it to prevent duplicate content problem
     
    techvivek, Dec 31, 2010 IP
  5. fsdnetwork

    fsdnetwork Peon

    Messages:
    20
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #25
    I recommend to use robots.txt always as is recommended by google, for example did you know you can add your sitemap file on robots.txt as a directive , take a look at this example

    ---- robots.txt ----

    User-Agent: *
    Allow: /

    Sitemap: http://www.yourdomain.com/sitemap.xml

    hope it help
     
    fsdnetwork, Feb 9, 2011 IP