Social Buttons
  1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Why can't Google find my robots.txt file

Discussion in 'Google Sitemaps' started by argent, Aug 22, 2006.

0
  1. #1
    Hi,
    In 'web crawl errors' under 'unreachable URLs' I get the following message:
    'URL unreachable /robots.txt unreachable' therefore google has postponed their crawl of my site. My robots.txt file is there in the root directory and named correctly. Does anyone know why google says it's 'unreachable' not 'not found' and how I can fix this?

    Any help appreciated.
    SEMrush
    argent
     
    argent, Aug 22, 2006 IP
    SEMrush
  2. drhyperlaur

    drhyperlaur Well-Known Member

    Messages:
    304
    Likes Received:
    18
    Best Answers:
    0
    Trophy Points:
    108
    #2
    check the permissions for robots.txt , it should be at least 444
     
    drhyperlaur, Aug 22, 2006 IP
  3. illuminator

    illuminator Peon

    Messages:
    10
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    What is your site? give me url
     
    illuminator, Aug 22, 2006 IP
  4. kyogen

    kyogen Peon

    Messages:
    33
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    kyogen, Aug 31, 2006 IP
  5. dcristo

    dcristo Illustrious Member

    Messages:
    19,748
    Likes Received:
    1,191
    Best Answers:
    7
    Trophy Points:
    470
    Articles:
    7
    #5
    I see this same error as well. In Google Sitemaps it says "5xx error robots.txt unreachable". I can access the robots.txt in my browser... in the root directory. Anyone know what could be up? The robots.txt file has 644 permissions.
     
    dcristo, Sep 9, 2006 IP