How to analyze robots.txt for errors ?

Discussion in 'robots.txt' started by durgesh871, Jun 30, 2010.

0
  1. #1
    Yahoo, Bing and Google offer their own webmaster tools for analyzing robots.txt. Dashboard of respective webmaster tool service will tell you what errors their search bots found with your robots.txt file. You can also check your robots.txt with 3rd party sites like shoemoney tools and correct these errors.
     
    durgesh871, Jun 30, 2010 IP
  2. Imozeb

    Imozeb Peon

    Messages:
    666
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Yes. Those tools are pretty useful though most of my robots.txt files are quite simple and don't require much checking.
     
    Imozeb, Jul 1, 2010 IP
  3. manish.chauhan

    manish.chauhan Well-Known Member

    Messages:
    1,682
    Likes Received:
    35
    Best Answers:
    0
    Trophy Points:
    110
    #3
    Well, you have already answered your query.
     
    manish.chauhan, Jul 1, 2010 IP
  4. alexeyd

    alexeyd Peon

    Messages:
    17
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    for analuzing the first you must to know how to create it and what exactly need to be disaloved for search bot. better ask about professional
     
    alexeyd, Jul 2, 2010 IP