yahoo!slurp or slurp in robots.txt

Discussion in 'Yahoo' started by anhthaiduong, Apr 6, 2008.

  1. #1
    what should i choose to state in robots.txt ? slurp or yahoo!slurp

    here's my robots.txt just allowing yahoo and google crawler

    User-agent:slurp
    dissallow:

    User-agent:googlebot
    dissallow:

    User-agent:*
    dissallow:/

    sitemap:htpp://.......
    --------------------------
    is it correct?
     
    anhthaiduong, Apr 6, 2008 IP