Why can't Google find my robots.txt file

Discussion in 'Google Sitemaps' started by argent, Aug 22, 2006.

0
  1. #1
    Hi,
    In 'web crawl errors' under 'unreachable URLs' I get the following message:
    'URL unreachable /robots.txt unreachable' therefore google has postponed their crawl of my site. My robots.txt file is there in the root directory and named correctly. Does anyone know why google says it's 'unreachable' not 'not found' and how I can fix this?

    Any help appreciated.

    argent
     
    argent, Aug 22, 2006 IP
  2. drhyperlaur

    drhyperlaur Well-Known Member

    Messages:
    307
    Likes Received:
    20
    Best Answers:
    0
    Trophy Points:
    108
    #2
    check the permissions for robots.txt , it should be at least 444
     
    drhyperlaur, Aug 22, 2006 IP
  3. illuminator

    illuminator Peon

    Messages:
    10
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    What is your site? give me url
     
    illuminator, Aug 22, 2006 IP
  4. kyogen

    kyogen Peon

    Messages:
    33
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    kyogen, Aug 31, 2006 IP
  5. dcristo

    dcristo Illustrious Member

    Messages:
    19,776
    Likes Received:
    1,200
    Best Answers:
    7
    Trophy Points:
    470
    Articles:
    7
    #5
    I see this same error as well. In Google Sitemaps it says "5xx error robots.txt unreachable". I can access the robots.txt in my browser... in the root directory. Anyone know what could be up? The robots.txt file has 644 permissions.
     
    dcristo, Sep 9, 2006 IP