Where's Googlebot?!

Discussion in 'Reviews' started by ItsAFastWorld, Nov 11, 2006.

  1. #1
    Hi Guys,

    Something really strange happened to me recently. The Googlebot usually visits my site several times a day, because content is extremely dynamic. Now I noticed that it hasn't been crawling my site for 3 days!!

    So I go to Google Webmaster Tools and it tells me that it faced many URL Timed Out Errors (DNS Lookup Timed Out), starting November 1 and ending just one day before it stopped visiting my site.

    In the main pages it says We can't currently access your home page because of a timeout.

    It still searches the subdomains though. If you guys have any idea on why this may be happening, I'll really appreciate it :D

    Thanks
     
    ItsAFastWorld, Nov 11, 2006 IP
  2. chovy

    chovy Peon

    Messages:
    181
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #2
    can you check log files and see if your server was down during that timeframe?
     
    chovy, Nov 11, 2006 IP
  3. ItsAFastWorld

    ItsAFastWorld Peon

    Messages:
    92
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #3
    nope, it's (and was) up and running :). I check it daily. Should I be worried that Google thinks my site is down? Could that be the reason it hasn't crawled my site for three days now (with the exception of the subdomains)?
     
    ItsAFastWorld, Nov 11, 2006 IP
  4. Lexiseek

    Lexiseek Banned

    Messages:
    2,499
    Likes Received:
    115
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Go to DNSreport and see if there's a problem.
     
    Lexiseek, Nov 11, 2006 IP
  5. ItsAFastWorld

    ItsAFastWorld Peon

    Messages:
    92
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #5
    The only "Fail" in the DNSreport is the following "Open DNS Server":

    Then there are three or four "Warning" (problems that are usually (apparently) not worth fixing)

    :confused:
     
    ItsAFastWorld, Nov 11, 2006 IP
  6. trichnosis

    trichnosis Prominent Member

    Messages:
    13,785
    Likes Received:
    333
    Best Answers:
    0
    Trophy Points:
    300
    #6
    what your url? can you write it here please?
     
    trichnosis, Nov 11, 2006 IP
  7. mattr2110

    mattr2110 Active Member

    Messages:
    323
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    53
    #7
    Yea google bot hasn't visited my site in a few days either :(
     
    mattr2110, Nov 11, 2006 IP
  8. ItsAFastWorld

    ItsAFastWorld Peon

    Messages:
    92
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #8
    OK, it's back on the site again :) . Strange.
     
    ItsAFastWorld, Nov 12, 2006 IP
  9. mattr2110

    mattr2110 Active Member

    Messages:
    323
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    53
    #9
    Yea mine too
     
    mattr2110, Nov 12, 2006 IP
  10. Hossam

    Hossam Peon

    Messages:
    196
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #10
    Just want to add that if your sites contents doesn't change more often, googlebots visits get decreased. Afterall, there is no point of spidering a site that has fixed contents.
     
    Hossam, Nov 13, 2006 IP
  11. mattr2110

    mattr2110 Active Member

    Messages:
    323
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    53
    #11
    Its not been back for 3-4 days?? My site is updated daily and I have links on several pr5+ sites.
     
    mattr2110, Nov 17, 2006 IP
  12. TechEvangelist

    TechEvangelist Guest

    Messages:
    919
    Likes Received:
    140
    Best Answers:
    0
    Trophy Points:
    133
    #12
    Does anyone know what that error message really means? I see the same message for several sites that I've checked, including DigitalPoint.com
     
    TechEvangelist, Nov 17, 2006 IP
  13. LongHaul

    LongHaul Peon

    Messages:
    670
    Likes Received:
    13
    Best Answers:
    0
    Trophy Points:
    0
    #13
    I've noticed this on my site, there seems a definite correlation to how often the bot comes and how often you put up new pages. But it always comes back eventually!
     
    LongHaul, Nov 17, 2006 IP
  14. kevinn

    kevinn Active Member

    Messages:
    1,337
    Likes Received:
    84
    Best Answers:
    0
    Trophy Points:
    90
    #14
    You didn't get the memo? It's taking a few weeks off! It's been working for 7 years non stop!
     
    kevinn, Nov 17, 2006 IP
  15. Dudibob

    Dudibob Peon

    Messages:
    618
    Likes Received:
    14
    Best Answers:
    0
    Trophy Points:
    0
    #15
    Sounds like your hosts may of been doing some work on the server and 'opened' it or something and Google queried your server, was afraid it might over-query it and gave up!?

    I'm not too hot with servers but I think it's something like that.
     
    Dudibob, Nov 17, 2006 IP
  16. mattr2110

    mattr2110 Active Member

    Messages:
    323
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    53
    #16
    Not sure what you mean.
     
    mattr2110, Nov 17, 2006 IP
  17. Dudibob

    Dudibob Peon

    Messages:
    618
    Likes Received:
    14
    Best Answers:
    0
    Trophy Points:
    0
    #17
    nore do I as I don't know a lot on servers lol

    Pretty much what I mean is that your hosts have/were doing something that possibly caused Googlebot to error which is why it timed out?
     
    Dudibob, Nov 17, 2006 IP
  18. mattr2110

    mattr2110 Active Member

    Messages:
    323
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    53
    #18
    Anyone know if my host could have dome something that would prevent or cause the google bot to time out?
     
    mattr2110, Nov 17, 2006 IP
  19. mattr2110

    mattr2110 Active Member

    Messages:
    323
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    53
    #19
    Why the hell was this moved to review this is a question related to google?
     
    mattr2110, Nov 18, 2006 IP