massive crawling

Discussion in 'Google' started by SpeedyDomainRegistration, Feb 6, 2005.

  1. #1
    Seems to be a massive update of Google database.
    Our servers have been massively hit by googlebot.

    This seems to be a renewed interest in quick crawling by google in response to MSN new campaign. I believe that google is trying to match the quick indexing of MSN. I have seen MSN crawling and indexing within 24 hours.

    I've test our submitting to MSN and getting crawl and index the same day.
    Google is lagging in this area and I think they are executing a plan to combat MSN.

    Crawling is one thing, indexing is another. We will have to see if google have make changes to when crawling occurs and when indexing occurs.
    We hope that the lag in google will improve due to MSN competition.

    What do you think?
     
  2. Googles76

    Googles76 Peon

    Messages:
    664
    Likes Received:
    26
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Recently I have also experiance this massive crawling both from Google and Yahoo, so we'll see what happens.
     
    Googles76, Feb 6, 2005 IP
  3. ResaleBroker

    ResaleBroker Active Member

    Messages:
    1,665
    Likes Received:
    50
    Best Answers:
    0
    Trophy Points:
    90
    #3
    I feel left out. Google hasn't come by in days. :(
     
    ResaleBroker, Feb 6, 2005 IP
  4. wiseone

    wiseone Peon

    Messages:
    72
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #4
    After Feb 2nd, I notice massive cralwing on our site... Seems like they are doing a re-index of our site... We are one of those that has experienced a big loss in traffic.
     
    wiseone, Feb 6, 2005 IP
  5. Chrissicom

    Chrissicom Guest

    Messages:
    261
    Likes Received:
    8
    Best Answers:
    0
    Trophy Points:
    0
    #5
    I made a slightly different experience. Google is crawling my site several times daily since a few months while MSN is only coming every 20-30 hours, although the indexing of MSN is a lot better. At least I show up on MSN with all my websites while only google.de has me #1 and google.com with a secondary domain (forum) #8 and not listed with the main page at all.
     
    Chrissicom, Feb 6, 2005 IP
  6. dejaone

    dejaone Well-Known Member

    Messages:
    992
    Likes Received:
    30
    Best Answers:
    0
    Trophy Points:
    143
    #6
    msn is catchinh up. size (of index database) matters in search engine market share.
     
    dejaone, Feb 6, 2005 IP