Help! Robots.txt file blocking Google Bot?

Discussion in 'Search Engine Optimization' started by Enmar, Mar 5, 2008.

  1. #1
    My wordpress blog was listed on the first page for a certain keyword. I went to check and it was completely gone. I went into Webmaster tools and found this:

    No pages from your site are currently included in Google's index. Indexing can take time. You may find it helpful to review our information for webmasters and webmaster guidelines.
    Loading...

    We can't currently access your home page because of a robots.txt restriction.

    What happened? How can I fix this? My site went from in the top 10 to completely off the index! I'm using a free wordpress.com blog. Is there something I did wrong?
     
    Enmar, Mar 5, 2008 IP
  2. exodus

    exodus Well-Known Member

    Messages:
    1,900
    Likes Received:
    35
    Best Answers:
    0
    Trophy Points:
    165
    #2
    blank out the robots.txt file
     
    exodus, Mar 5, 2008 IP
  3. Enmar

    Enmar Active Member

    Messages:
    177
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    60
    #3
    Do you know how I would do this in the wordpress blog options?

    This is what my robots.txt looks like right now, no idea how it changed.

    User-agent: *
    Disallow: /
     
    Enmar, Mar 5, 2008 IP
  4. Enmar

    Enmar Active Member

    Messages:
    177
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    60
    #4
    How do I change the file on wordpress? It does not have an options place for the robots.txt file.
     
    Enmar, Mar 5, 2008 IP
  5. redgsr

    redgsr Well-Known Member

    Messages:
    1,603
    Likes Received:
    62
    Best Answers:
    0
    Trophy Points:
    165
    #5
    Do you have your blog hosted on your own server?
     
    redgsr, Mar 5, 2008 IP
  6. Enmar

    Enmar Active Member

    Messages:
    177
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    60
    #6
    No, its a free wordpress.com blog.
     
    Enmar, Mar 5, 2008 IP
  7. JTChandler

    JTChandler Peon

    Messages:
    15
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #7
    did you change themes lately? can you access the header.php file from the dashboard>presentation>theme editor menu?
     
    JTChandler, Mar 5, 2008 IP
  8. Enmar

    Enmar Active Member

    Messages:
    177
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    60
    #8
    Didn't change any themes, I can get to the Custom Header page if thats what you mean?
     
    Enmar, Mar 5, 2008 IP
  9. JTChandler

    JTChandler Peon

    Messages:
    15
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #9
    "Custom Header page"... not exactly what I meant. I don't believe you can access the theme files on the free version so disregard what I said.
     
    JTChandler, Mar 5, 2008 IP
  10. dpking

    dpking Peon

    Messages:
    1,021
    Likes Received:
    16
    Best Answers:
    0
    Trophy Points:
    0
    #10
    I will suggest you to delete the robots.txt file if it is causing probs .. make sure if u dnt have a blog directory !!
     
    dpking, Mar 5, 2008 IP
  11. cooldude7273

    cooldude7273 Active Member

    Messages:
    185
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    55
    #11
    If you don't want to block bots, then there really is no need for robots.txt in your case.
     
    cooldude7273, Mar 5, 2008 IP
  12. Enmar

    Enmar Active Member

    Messages:
    177
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    60
    #12
    The problem is there is no place where I can see, edit, or delete the robots.txt.
     
    Enmar, Mar 6, 2008 IP
  13. exodus

    exodus Well-Known Member

    Messages:
    1,900
    Likes Received:
    35
    Best Answers:
    0
    Trophy Points:
    165
    #13
    Then you are out of luck then.
     
    exodus, Mar 6, 2008 IP