20 spiders at my site simultaneously.

Discussion in 'SEO' started by Creature, Feb 27, 2007.

  1. #1
    Hello all

    The last 3 days something strange happens with my site.
    It gets many spiders at once.
    It even got at 20 spiders the same time indexing my forums. www.gamesbucket.com/forums

    Many are google spiders. But the most are yahoo slurp. Also msn bot.

    They are everywhere in my forums. I suppose this is a very good thing but where did they come from?
    All together and this time.

    Its a bit strange but I guess its a good thing.

    cheers
     
    Creature, Feb 27, 2007 IP
  2. Pierce

    Pierce Active Member

    Messages:
    634
    Likes Received:
    26
    Best Answers:
    0
    Trophy Points:
    95
    #2
    i have vbulletin too.

    Google usualy only has 2 spiders, the adsense and crawler, maybe 2 crawler bots at the same time, but rare i havnt seen that much.

    But yahoo, they use a different ip for each bot, as such thats why it looks like theres 20 odd bots at the same time. But none are on during the same minute.

    They come to you because of the link in your signature ? :)

    Pierce
     
    Pierce, Feb 27, 2007 IP
  3. QuEST

    QuEST Peon

    Messages:
    98
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #3
    even i have noticed similar activity.. not 20 but abut 3-5 :) but i just love it :D as i guess my new site is surely getting indexed
     
    QuEST, Feb 27, 2007 IP
  4. Pierce

    Pierce Active Member

    Messages:
    634
    Likes Received:
    26
    Best Answers:
    0
    Trophy Points:
    95
    #4
    nope, you cant. Though its blogger so you can be sure it will be indexed :)

    Pierce
     
    Pierce, Feb 27, 2007 IP
  5. xtraze

    xtraze Peon

    Messages:
    396
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    0
    #5
    You guys know what ?
    I love spiders.

    But only 2 spiders like my forum :(

    Google.com and Archive.org
    And a few unknown spiders.
     
    xtraze, Mar 1, 2007 IP