1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Why is Yahoo crawling my site to death?

Discussion in 'Yahoo' started by hmansfield, May 21, 2007.

0
Page 1 of 2
  1. #1
    I have 3 IP addresses from Yahoo that are crawling me to death and driving up bandwidth:

    216.109.121.44 / 11594/11594 /400.13 MB / 19 May 2007 - 23:13
    216.109.121.41 /11560 / 11561 /405.01 MB / 19 May 2007 - 23:12
    216.109.121.42 / 11374 / 11374 /398.89 MB /19 May 2007 - 23:13

    Anybody know why? And what can I do about it?
     
    hmansfield, May 21, 2007 IP
  2. Lordy

    Lordy Peon

    Messages:
    1,643
    Likes Received:
    29
    Best Answers:
    0
    Trophy Points:
    0
    #2
    They think you are attractive
     
    Lordy, May 21, 2007 IP
  3. forumrating

    forumrating Notable Member

    Messages:
    6,565
    Likes Received:
    347
    Best Answers:
    0
    Trophy Points:
    275
    #3
    yahoo loves your site, well it must be having lot of backlinks from big sites for sure. so the bots would keep coming from somewhere or the other
    to be precise yahoo bots love ur site.
     
    forumrating, May 21, 2007 IP
  4. hmansfield

    hmansfield Guest

    Messages:
    7,904
    Likes Received:
    298
    Best Answers:
    0
    Trophy Points:
    280
    #4
    No. It doesn't. It's brand new, only 30-40 days old.
    I haven't seen any big number of back links, a few hundred directories,and around 3-4 reciprocals, that's it!
    It does have a lot of ages, but this is going on about 20 days now.
     
    hmansfield, May 21, 2007 IP
  5. temujin

    temujin Peon

    Messages:
    664
    Likes Received:
    8
    Best Answers:
    0
    Trophy Points:
    0
    #5
    bots need love too.
     
    temujin, May 22, 2007 IP
  6. Claudek

    Claudek Well-Known Member

    Messages:
    1,379
    Likes Received:
    81
    Best Answers:
    0
    Trophy Points:
    165
    #6
    Claudek, May 22, 2007 IP
    hmansfield likes this.
  7. Optimus Crime

    Optimus Crime Well-Known Member

    Messages:
    648
    Likes Received:
    19
    Best Answers:
    0
    Trophy Points:
    110
    #7
    Can you PM me your site url?
     
    Optimus Crime, May 22, 2007 IP
  8. kgrad

    kgrad Well-Known Member

    Messages:
    2,414
    Likes Received:
    82
    Best Answers:
    0
    Trophy Points:
    130
    #8
    Yeah, please share your site URL with us,
    I will be able to advise better that way.
    Or if you want privacy for certain reasons, feel free to PM me. :eek:
     
    kgrad, May 22, 2007 IP
  9. Kontent.solutions

    Kontent.solutions Peon

    Messages:
    1,157
    Likes Received:
    59
    Best Answers:
    0
    Trophy Points:
    0
    #9
    Send 'em over to my site ;)

    ~G
     
    Kontent.solutions, May 22, 2007 IP
  10. ellict

    ellict Peon

    Messages:
    91
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #10
    two or three gigs in a month was normal for google/yahoo, as others say, you should be happy they love you, thousand of site waiting g/y robot to crawl not only homepage but child page also
     
    ellict, May 22, 2007 IP
    hmansfield likes this.
  11. threedogs

    threedogs Peon

    Messages:
    24
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #11
    Hey, I'm just a newbie here - but isn't this a GOOD thing? Isn't this how we mke $$ (if the IM gods are on our side..;))?

    Lynne
     
    threedogs, May 22, 2007 IP
  12. ezguy

    ezguy Well-Known Member

    Messages:
    1,184
    Likes Received:
    18
    Best Answers:
    0
    Trophy Points:
    128
    #12
    well it is crawling because it is a worm :) spray some pesticides and it will die :)
     
    ezguy, May 22, 2007 IP
  13. hmansfield

    hmansfield Guest

    Messages:
    7,904
    Likes Received:
    298
    Best Answers:
    0
    Trophy Points:
    280
    #13
    Sorry the URL is in my profile, 124bpms.com

    I'm only going on the word of one of my associates that is telling me that this seems to be abnormal activity, because the traffic doesn't seem to match the bandwidth, however, I don't think he understands how many pages I have indexed,(over 3,000).
    Interested in more opinions after you see the site I'm referring to.
    Thanks
     
    hmansfield, May 22, 2007 IP
  14. UnderEstimated

    UnderEstimated Well-Known Member

    Messages:
    388
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    145
    #14
    lol at my forum there are always 250 to 350 Guests and 200 out of em are Yahoo Spiders
     
    UnderEstimated, May 22, 2007 IP
    hmansfield likes this.
  15. ezguy

    ezguy Well-Known Member

    Messages:
    1,184
    Likes Received:
    18
    Best Answers:
    0
    Trophy Points:
    128
    #15
    that says it all. of all the guests on Dp i think thousand of them are spiders :)
     
    ezguy, May 22, 2007 IP
    hmansfield likes this.
  16. hmansfield

    hmansfield Guest

    Messages:
    7,904
    Likes Received:
    298
    Best Answers:
    0
    Trophy Points:
    280
    #16
    Thanks. I feel much better. Someone was telling me that I was doing something wrong to eat up that much bandwidth, and it freaked me out, because I don't know any "tricks".
    I will smack him in the back of the head when I see him.
    Thanks
     
    hmansfield, May 22, 2007 IP
  17. MrMean

    MrMean Guest

    Messages:
    98
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #17
    Off topic but cool site! Congrats the Search Engines must like it :p
     
    MrMean, May 22, 2007 IP
    hmansfield likes this.
  18. Qryztufre

    Qryztufre Prominent Member

    Messages:
    6,071
    Likes Received:
    491
    Best Answers:
    0
    Trophy Points:
    300
    #18
    I generally have more SLURP!s then any other guest on at nearly any moment. However with all of the Yahoo Bots bombarding my pages MSN bots suck more bandwidth (with HALF the hits). Though, I'm not concerned with either, as the effects on my monthly quota are minimal at worst.

    One thing I have noticed though, is that YAHOO seems to take a page into it's index, then sends out several other bots to check links individually. I've set to actually see one CRAWL my site. Googlebots on the other hand will visit a page, follow a link from that page, follow a link from that page, and so on.

    That means that one googlebot can do what it takes 20 yahoo SLURP! bots to do.
     
    Qryztufre, May 22, 2007 IP
    hmansfield likes this.
  19. jageddes

    jageddes Peon

    Messages:
    10
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #19
    You have something they want!
     
    jageddes, May 22, 2007 IP
  20. hmansfield

    hmansfield Guest

    Messages:
    7,904
    Likes Received:
    298
    Best Answers:
    0
    Trophy Points:
    280
    #20
    Thanks. Still working on it, but it's a lot of fun.
    I keep hearing these words in my head from one of my associate webmasters, "..And you think you can do all that will a little blog :p ?"

    :mad:
     
    hmansfield, May 22, 2007 IP
Page 1 of 2