robots.txt unreachable

Discussion in 'Google Sitemaps' started by i_am_dhaval, Nov 9, 2009.

  1. #1
    robots.txt unreachable

    why i see this type of message in google webmaster tool?
     
    i_am_dhaval, Nov 9, 2009 IP
  2. webrickco

    webrickco Active Member

    Messages:
    268
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    60
    #2
    Hello,

    Do you have a robots.txt file on your server?

    Robots are used to indicate informations used by SE spiders. For instance you can tell spiders not to follow some directories (like image directories for example: Disallow: /images), or to name where your Sitemap is located (for example sitemap: http://www.yoursite.com/sitemap.xml).

    If this file is not present, google webmaster tool will alert you.
     
    webrickco, Nov 9, 2009 IP
  3. kailash

    kailash Well-Known Member

    Messages:
    1,248
    Likes Received:
    42
    Best Answers:
    0
    Trophy Points:
    190
    #3
    kailash, Nov 9, 2009 IP
  4. kitakaze99

    kitakaze99 Peon

    Messages:
    27
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    I've seen that thing too.... :( but it juts disappear in a few day... I don't know where it came from..
     
    kitakaze99, Nov 11, 2009 IP
  5. Afqam

    Afqam Greenhorn

    Messages:
    87
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    16
    #5
    Check your robots.txt using yourdomain/robots.txt if you see then check spelling in webmaster tools if clear then copy robots.txt file again in your server root folder
     
    Afqam, Nov 12, 2009 IP
  6. vlwebhosting

    vlwebhosting Guest

    Messages:
    25
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #6
    u can allways include robots in your html tags on web page that will make them visible for search engines
     
    vlwebhosting, Nov 12, 2009 IP
  7. xhanch

    xhanch Member

    Messages:
    683
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    35
    #7
    What's your website. You have to mention it so we can have a look..
     
    xhanch, Nov 14, 2009 IP
  8. topaix

    topaix Peon

    Messages:
    32
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #8
    I have exactly the same problem with one of my site http://articles.topaix.com

    I have about more than 1000 page showing "robots.txt unreachable". I have tried checking robots.txt file and did some tweaking too and waited for about 1 months but nothing has changed. If you have any suggestion, please help me resolve this issue.
     
    topaix, Mar 16, 2011 IP
  9. opiz2012

    opiz2012 Peon

    Messages:
    32
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #9
    Are you sure your robots.txt file in the root directory of your site? If so, you use google site management tool then generates a new robots.txt file, put it on the root directory of your site, to replace the original trial next!
     
    opiz2012, Mar 17, 2011 IP