Yahoo Crawler

Hi

Does anyone know what the yahoo spider is called, I never see it in my logs, I always see Googlebot, MSN, Inktomi various others but not Yahoo,

Thanks

 

Hello,

The Yahoo spider is called Slurp.
The user agent looks like:
Slurp/2.0 (slurp@inktomi.com; http://www.inktomi.com/slurp.html)
Slurp.so/1.0 (slurp@inktomi.com; http://www.inktomi.com/slurp.html)
Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)

Further information is to be found here:
help.yahoo.com/help/us/ysearch/slurp/

Neil

 

Ever since the summer when they introduced their new version of Slurp, all the hits from Yahoo on my sites are showing from Inktomi instead of Yahoo..

 

Ahhh Inktomi, makes sense now

thanks

 

slurp. i was always wondering what the slurp bot was. i eventually googled it.

 

But I saw inktomi and slurp both visited my websites. Inktomi visits my site about 1 time/week, while slurp 1 time/month.

 

Yeah, their crawler is called Slurp. They still have Inktomi Slurp and there are 2 other Slurps that I have seen show up in my logs.

 

Thanks for information.

 

I've always wondered what Inktomi was ..

Dont think I ever bothered to look into it.

Thx for the info.

 

this slurp has been crawling me and my client sites a lot lately eating up huge amounts of bandwith in the process.

 

Inktome is the Yahoo bot, now known as SLURP.

 

Yeah, in my forum, now there are 30+ inktomi bots, even first I was afraid of it was an attack.

 

cool good to know

 

what is inktomi stands for??

 

Slurp has been eating up my bandwith the last couple months.......