Googlebot has not successfully crawled

Discussion in 'Google' started by adfodo, Jun 17, 2008.

  1. #1
    Googlebot has been on my site a number of times and crawled but when I log into webmaster tools it says it has not successfully crawled since may 5. Anyone know why?
     
    adfodo, Jun 17, 2008 IP
  2. trademark714

    trademark714 Active Member

    Messages:
    189
    Likes Received:
    5
    Best Answers:
    0
    Trophy Points:
    58
    #2
    is it a private site? do you need a password or sign up to get in?
     
    trademark714, Jun 17, 2008 IP
  3. enous

    enous Well-Known Member

    Messages:
    1,500
    Likes Received:
    16
    Best Answers:
    0
    Trophy Points:
    158
    #3
    yeah, you should add Robot.txt to your site.
     
    enous, Jun 17, 2008 IP
  4. adfodo

    adfodo Peon

    Messages:
    352
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #4
    can you explain why that would help?
     
    adfodo, Jun 17, 2008 IP
  5. adfodo

    adfodo Peon

    Messages:
    352
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #5
    I'm looking at the cache on google and pages of my site have been cached june 1, june 8, june 11th. So I'm not quite sure am I missing something here.
     
    adfodo, Jun 17, 2008 IP
  6. adfodo

    adfodo Peon

    Messages:
    352
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #6
    no it's not.
     
    adfodo, Jun 17, 2008 IP
  7. tattoos

    tattoos Prominent Member

    Messages:
    1,903
    Likes Received:
    150
    Best Answers:
    0
    Trophy Points:
    335
    #7
    One of my sites says "Googlebot last successfully accessed your home page on May 25, 2008."

    Don't worry about it... Its lying :D

    Seriously, in webmaster tools click on the "Sitemaps" link on the left, and you will see. Even though mine says "Googlebot last successfully accessed your home page on May 25, 2008." it also says my sitemap was... Last Downloaded 21 hours ago Status OK.

    And if I click "Tools" then "Analyze robots.txt" it says... Last downloaded 7 hours ago. Status 200 (Success) :D

    And now click "Set crawl rate" and it will say "Googlebot activity in the last 90 days" and also "Number of pages crawled per day" "Average"
    What does your average say? if it says 0, then you should worry.. If it doesn't then don't worry..

    Webmaster tools sometimes just takes a while to update the "Overview" stats that's all.

    Hope that make you feel better;)

    Cheers
    James
     
    tattoos, Jun 17, 2008 IP