robots error question

Discussion in 'robots.txt' started by PitbullJack, May 31, 2009.

  1. #1
    I uploaded a robots.txt file and a sitemap to my sites. I used this robots.txt
    User-agent: *
    Disallow: /images/
    Disallow: /App_Themes/
    Disallow: /bin/
    Disallow: /CommImages/
    Disallow: /ProImages/

    User-agent: Googlebot-Image
    Disallow: /*.gif$
    Disallow: /*.jpeg$
    Disallow: /*.jpg$
    Disallow: /*.bmp$


    I get this error in google webmaster tools when I submit sitemap

    Network unreachable: robots.txt unreachable
    We were unable to crawl your Sitemap because we found a robots.txt file at the root of your site but were unable to download it. Please ensure that it is accessible or remove it completely.

    I removed the robots file and I still get his error?
    Any Ideas?
     
    PitbullJack, May 31, 2009 IP
  2. eklypse

    eklypse Active Member

    Messages:
    84
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    93
    #2
    Did you have the file in root (site.com/robots.txt)? What about permissions?
     
    eklypse, May 31, 2009 IP
  3. PitbullJack

    PitbullJack Peon

    Messages:
    47
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Im a noob so I will try to explain LOL what I did. It is a basic html so i just ftp it in the folder with the index.html, pic etc.... as for permissions I didnt do any of that I just copied the robots.txt from a thread on DP and saved it in note pad and ftp it to the folder with the website files in it.
     
    PitbullJack, May 31, 2009 IP
  4. eklypse

    eklypse Active Member

    Messages:
    84
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    93
    #4
    What do you mean by "basic html"? If you saved the file as robots.txt and uploaded to root folder it should be working...To check permissions (in ftp client) you should be able to right click the uploaded file and enter 644.
     
    eklypse, May 31, 2009 IP
  5. linkdealer

    linkdealer Active Member

    Messages:
    138
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    90
    #5
    I don't find any reason of an error, if you have put the robots.txt file in the root folder
     
    linkdealer, Jun 8, 2009 IP