MSN has spidered my site 147 times this month, why?

Discussion in 'Bing' started by GreenGambler, Nov 22, 2005.

  1. 802networks

    802networks Guest

    Messages:
    132
    Likes Received:
    5
    Best Answers:
    0
    Trophy Points:
    0
    #21
    It takes a while for MSN to list you at first. They also spider me MUCH more than any other spiders. I think they like to do a complete job. You will notice listings soon.. Don't worry.
     
    802networks, Feb 18, 2006 IP
  2. poseidon

    poseidon Banned

    Messages:
    4,356
    Likes Received:
    246
    Best Answers:
    0
    Trophy Points:
    0
    #22
    isn't too much spidering a waste of bandwidth specially if your site is not getting updated too often ? may be you want to modify your robots.txt file
     
    poseidon, Feb 18, 2006 IP
  3. GreenGambler

    GreenGambler Notable Member

    Messages:
    1,841
    Likes Received:
    117
    Best Answers:
    0
    Trophy Points:
    200
    #23
    I don't mind the wasted bandwidth, not yet at least. So they can keep on a-coming. BTW I get thousands a month now:) From at least 15 dif spiders.
     
    GreenGambler, Jul 23, 2006 IP
  4. kozuch82

    kozuch82 Peon

    Messages:
    266
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #24
    Its only different spidering technique. Thats all.
     
    kozuch82, Jul 24, 2006 IP
  5. chachacallis

    chachacallis Well-Known Member

    Messages:
    1,086
    Likes Received:
    14
    Best Answers:
    0
    Trophy Points:
    128
    #25
    i guess when you start getting lots of people to your website you will start worrying about bandwidth
     
    chachacallis, Jul 24, 2006 IP
  6. duilen

    duilen Active Member

    Messages:
    354
    Likes Received:
    10
    Best Answers:
    0
    Trophy Points:
    58
    #26
    Being crawled 147 times really doesn't mean very much. I have a site that has been crawled 30k times by google this month and it hasn't noticeably effected my rankings.
     
    duilen, Jul 24, 2006 IP
  7. stringerbell

    stringerbell Peon

    Messages:
    78
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #27
    I bet if you check, you'll find that the robots just look at a few of your pages each time they visit, which would mean that they have to visit a lot of times before they find all your pages.
     
    stringerbell, Jul 24, 2006 IP