1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Google behavior changing

Discussion in 'Google' started by iconv, May 10, 2004.

  1. #1
    For the last week or so, I have seen different Googlebot behavior compared to the last three months. It used to be that my site would be visited once a day, every day, and that new pages would be picked up and indexed a few hours after Googlebot's reading of the page that links to them.
    However, this is not the case anymore. Googlebot still visits every day, but new pages are not being picked up. This has been going on for almost a week now; I have seen the odd hit on a new page (all html, btw), but none of them show in the Google cache. The daily visit just cyles through the old pages Google already new.
    Also, 404s are not being processed properly, in that the page that disappeared is not removed from the SERPs, also for about a week now.

    Has anyone observed similar change in behavior, or is it just my site? I'm a bit worried that my new pages create some kind of problem for Googlebot, although I haven't been able to find anything obviously wrong with them.
     
    iconv, May 10, 2004 IP
  2. hexed

    hexed Peon

    Messages:
    333
    Likes Received:
    11
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Agreed.

    I went from 300 indexed pages to 6500 indexed pages yesterday :p

    hexed
     
    hexed, May 10, 2004 IP
  3. Will.Spencer

    Will.Spencer NetBuilder

    Messages:
    14,789
    Likes Received:
    1,040
    Best Answers:
    0
    Trophy Points:
    375
    #3
    iconv:

    I have noticed similar behavior at http://www.fortliberty.org.

    Every night, Googlebot stops by to get the same old pages again and again. But new pages are taking longer than normal to be crawled and to be indexed.

    Will
     
    Will.Spencer, May 10, 2004 IP
  4. leo

    leo Peon

    Messages:
    174
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Can't confirm that observation. I got a newly added page indexed right within hours.
     
    leo, May 10, 2004 IP
  5. pcarlow

    pcarlow Active Member

    Messages:
    774
    Likes Received:
    20
    Best Answers:
    0
    Trophy Points:
    90
    #5
    My updates and new pages haven't being cached or added to the index for over a week now. I keep checking every day.
     
    pcarlow, May 10, 2004 IP
  6. Atlanta Realtor

    Atlanta Realtor Peon

    Messages:
    78
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #6
    I am seeing google visit everyday and cache new pages daily and index them pretty much the same day or the next day.
     
    Atlanta Realtor, May 13, 2004 IP
  7. eCommando

    eCommando Well-Known Member

    Messages:
    115
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    103
    #7
    I am noticing that GoogleBot is coming more often and taking a lot more pages from my sites including the bandwidth (double the bandwidth from last month, and it's only 1/2 of the month)
     
    eCommando, May 14, 2004 IP
  8. Such Great Heights

    Such Great Heights Peon

    Messages:
    715
    Likes Received:
    19
    Best Answers:
    0
    Trophy Points:
    0
    #8
    Googlebot seems to be on track with what they did last month for us.
    Last month Googlebot visited 900+ times, well that how many hits our stats recorded, and so far this month has been 300+. Bandwidth last month was about 5MB, this month only 1.5MB so far.
    As far as I can tell Googlebot visits about once maybe twice every 24 hours.

    Seems normal here.
     
    Such Great Heights, May 14, 2004 IP
  9. schlottke

    schlottke Peon

    Messages:
    2,185
    Likes Received:
    63
    Best Answers:
    0
    Trophy Points:
    0
    #9
    Are you changing the pages that aren't getting updated?
     
    schlottke, May 14, 2004 IP
  10. iconv

    iconv Well-Known Member

    Messages:
    189
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    108
    #10
    Things seem to be back to normal now, thanks for all your support.
     
    iconv, May 15, 2004 IP
  11. greg

    greg Peon

    Messages:
    30
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #11
    I can honestly say that I havn't seen this at all. I recently revamped the whole site(went from .html to .php) and every single page changed, within a day google was reflecting the new pages.

    Another example, I created a brand new page yesterday around 6 p.m. that had no previous links to it. By 10 p.m. the page was crawled
     
    greg, May 15, 2004 IP