Problem with googlebot indexing

Discussion in 'Google Sitemaps' started by tweez79, Sep 11, 2009.

  1. #1
    I'm getting an error message from googlebot saing:"robots.txt file does not appear to be valid" I guess the problem is when I have made a site redirection to my other site.I made this in the Google admin panel/webmasters/tools/change-address. can anyone tell me how can i fix this? Thanks in advance.
     
    tweez79, Sep 11, 2009 IP
  2. brownman

    brownman Peon

    Messages:
    38
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Does yoursite.com/robots.txt shows text?
    May be it redirects to index page of the new site. Then definitely your robots.txt won't be valid.
     
    brownman, Sep 16, 2009 IP
  3. ohteddy

    ohteddy Member

    Messages:
    128
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    28
    #3
    Google also makes it very clear that robots.txt needs to be a UTF8 encoded file. I'd confirm it is if you haven't already.
     
    ohteddy, Sep 18, 2009 IP