Broken robots.txt or google being funny?

Discussion in 'robots.txt' started by m0nkeymafia, Apr 5, 2009.

  1. #1
    Hey

    I have a site that has been working fine with the same robots.txt for years, suddenly on thursday/friday google decided that my robots.txt actually blocks the entire site [according to webmaster tools]

    Here is my robots.txt

    So according to webmaster tools my main URL and others are blocked as of 2nd April... I have not changed anything.

    One thing to note is that google webmaster tools see my site as http://example.com and I redirect to the www. version. But my robots.txt doesnt specify either, neither does it block the main URL - EDIT: I added www.example.com to webmaster tools too, this shows no errors.

    Can anyone shed some light on this?

    Thanks
     
    m0nkeymafia, Apr 5, 2009 IP
  2. pipes

    pipes Prominent Member

    Messages:
    12,766
    Likes Received:
    958
    Best Answers:
    0
    Trophy Points:
    360
    #2
    Are you still seeing the same problem?
     
    pipes, Apr 26, 2009 IP
  3. m0nkeymafia

    m0nkeymafia Well-Known Member

    Messages:
    399
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    125
    #3
    Hey, thanks for the reply!
    I contacted google after I got stumped and they said that my site had been removed using the google url removal tool! Shocking to say the least but my site has now returned!
     
    m0nkeymafia, Apr 26, 2009 IP
  4. pipes

    pipes Prominent Member

    Messages:
    12,766
    Likes Received:
    958
    Best Answers:
    0
    Trophy Points:
    360
    #4
    Hi m0nkeymafia, thats worrying and im sorry to discover that happend to your site, ive not come across this before.

    Im pleased that you got it sorted.
     
    pipes, Apr 26, 2009 IP
  5. m0nkeymafia

    m0nkeymafia Well-Known Member

    Messages:
    399
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    125
    #5
    Cheers mate, and yes it is!! Very worrying... I quickly changed all my passwords and crossed my fingers haha
     
    m0nkeymafia, Apr 26, 2009 IP