Suddenly swarmed by the Slurp Spider.

My site has been running for 3 weeks now and I've had an average of around 3 slurp spiders on there at any one time. All of a sudden today I got hit by 70 of them all at once.

What could be the reason for this? The only thing I can think of is ( and I doubt it is) is that I uploaded to sitemap to Google last night, but the wasn't formatted correctly so failed anyway.

Why the sudden swarm by the slurp?

Thanks

 

i used to get like 4-5 at a time, but in the last few days it jumped like 8-10 and today it was an all time high of about 18 yahoo bots at a time. i havent checked the total of the bots/day but its surely going to be a larger number today

 

Serious, mine went from like 5 to 80! Gotta be a reason for this.

 

Maybe you put something fresh and useful on your site. Or maybe you have been putting links to your site from other locations that are just catching on.

 

This happened to me yesterday also or possibly on Saturday. It went up from around 5 a day to 81 on at the same time !!

Weird !

 

Yes, same here. Noticed ~2 weeks ago.

I got like 1000 hits from Google and over 2000 from Yahoo...

 

I noticed both Yahoo and Google bots craweled one of my sites as well. But I figure that happens when you just finished building the site and submitting it to SE et cetera. Of course their gonna be on your sites like white on rice.

 

For some reason Yahoo's bot has been on our site 3 times more than G lately... yet we get much more traffic from G than from Y.

Not sure what Slurp is up to.

 

Yeah Slurp is a hungry bugger, 1GB and nearly 100,000 hits of plain text.

 

It sure is hungry..

 

I have also had a sudden rush of 50 yahoo bots on my site the same time from different ip's, if i remember correctly it happen either the 29th or the 30th of june.

Thats when i updated my blog for the whole "iphone release" and the "iphone line". I figured that may be that was the case.

May be i could be wrong?

 

They've been having their way with my site as well. I can't wash the dirty feeling away...

 

I feel violated as well..I have a loot of content but I saw that dramatic change as well quickly.

 

sound like those spider i just passing though. a new sight like that. hmm funny.

 

Yeah I experienced this as well not to long back, over 100 bots on my forum. Crazy!

 

Is that from one week, month, or all time?

 

That was for the 4 days of July, its well over 2GB now. Funny thing is Yahoo brings almost zero traffic, if i didnt have a stack of bandwidth id honestly just block Yahoo completely.