I have 3 IP addresses from Yahoo that are crawling me to death and driving up bandwidth: 216.109.121.44 / 11594/11594 /400.13 MB / 19 May 2007 - 23:13 216.109.121.41 /11560 / 11561 /405.01 MB / 19 May 2007 - 23:12 216.109.121.42 / 11374 / 11374 /398.89 MB /19 May 2007 - 23:13 Anybody know why? And what can I do about it?
yahoo loves your site, well it must be having lot of backlinks from big sites for sure. so the bots would keep coming from somewhere or the other to be precise yahoo bots love ur site.
No. It doesn't. It's brand new, only 30-40 days old. I haven't seen any big number of back links, a few hundred directories,and around 3-4 reciprocals, that's it! It does have a lot of ages, but this is going on about 20 days now.
Yeah, please share your site URL with us, I will be able to advise better that way. Or if you want privacy for certain reasons, feel free to PM me.
two or three gigs in a month was normal for google/yahoo, as others say, you should be happy they love you, thousand of site waiting g/y robot to crawl not only homepage but child page also
Hey, I'm just a newbie here - but isn't this a GOOD thing? Isn't this how we mke $$ (if the IM gods are on our side..)? Lynne
Sorry the URL is in my profile, 124bpms.com I'm only going on the word of one of my associates that is telling me that this seems to be abnormal activity, because the traffic doesn't seem to match the bandwidth, however, I don't think he understands how many pages I have indexed,(over 3,000). Interested in more opinions after you see the site I'm referring to. Thanks
Thanks. I feel much better. Someone was telling me that I was doing something wrong to eat up that much bandwidth, and it freaked me out, because I don't know any "tricks". I will smack him in the back of the head when I see him. Thanks
I generally have more SLURP!s then any other guest on at nearly any moment. However with all of the Yahoo Bots bombarding my pages MSN bots suck more bandwidth (with HALF the hits). Though, I'm not concerned with either, as the effects on my monthly quota are minimal at worst. One thing I have noticed though, is that YAHOO seems to take a page into it's index, then sends out several other bots to check links individually. I've set to actually see one CRAWL my site. Googlebots on the other hand will visit a page, follow a link from that page, follow a link from that page, and so on. That means that one googlebot can do what it takes 20 yahoo SLURP! bots to do.
Thanks. Still working on it, but it's a lot of fun. I keep hearing these words in my head from one of my associate webmasters, "..And you think you can do all that will a little blog ?"