WTF? Google webmaster tool can't find one robots.txt?

Discussion in 'robots.txt' started by scubita, Sep 29, 2008.

0
  1. #1
    Hi guys,

    This is happening for some weeks and clients site is dropping quickly in serp's. The reason? Google can't find the robots.txt file. Funny thing, the file is always there:

    User-agent: *
    Disallow: /cgi-bin/

    Wtf is going on, and how can we change this stupid situation?

    Thanks in advance guys.
     
    scubita, Sep 29, 2008 IP
  2. scubita

    scubita Peon

    Messages:
    5,550
    Likes Received:
    318
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Any input for this question appreciated!
     
    scubita, Oct 1, 2008 IP
  3. himtuna

    himtuna Member

    Messages:
    225
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    28
    #3
    check with the permission and did you try accessing it online
    yourdomain.tld/robots.txt
     
    himtuna, Oct 6, 2008 IP
    scubita likes this.
  4. scubita

    scubita Peon

    Messages:
    5,550
    Likes Received:
    318
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Thanks for feedback.

    Yep i've checked it online and it's there. Permissions? Like 775? What's the usual permission for it?

    Anyway, this a file copied from another site from us. Didn't made any change to it.Just upload to server. Our hosting company told us to check .htaccess...?

    Thanks again, rep added.
     
    scubita, Oct 6, 2008 IP