YPN Spider

Does Yahoo have a different spider like adsense does when it tries to figure out what your site is about? If so, what does it look like in the logs and how often does it come around?

Thanks!

 

You'll see the "YahooYSMcm" in your logs.

AmCy

 

For adsense to spider your site, you put the following into your robots.txt file.
User-agent: Mediapartners-Google*

What would the same be for YPN?

thanks,

-PYJAMA

 

I was under the impression you only list bots in the robots.txt that you want to block.

 

Yes, but Adsense suggests you place that line in your robots.txt file, at least they used to anyway.

I'm not aware of a similar suggestion from Yahoo. Anyone?

 

is'nt "yahoo slurp" bot the ypn bot? or is that just the regular yahoo search bot?

 

Slurp is the regular bot...YahooYSMcm is the YPN bot...I've started seeing in my logs.

 

I just saw the supoosed YPN bot on a site that doesn't have YPN. This is the bot that visited: YahooYSMcm/2.0.0.

This site is brand new 2 weeks er so.

The strange thing is that it Y is not listed in my stats program as visiting yet (I found it in my raw logs this morning. I've been checking every morning since its a new site) AND the only page it came to is a write up about Yahoo music program....not the main index page. How they found it is a mystery since I see no trace of yahoo other than that one hit and I don't physically link to their music site.

Anyone else seen this bot that doesn't have YPN on their site?

 

It will visit, no need to ad anything to the robots.txt file.