Excluding a page and all spiders except Google

Discussion in 'robots.txt' started by TheMrAnderson, Oct 20, 2008.

0
  1. #1
    I wish to stop all spiders visiting two pages on my site and all spiders except Google. I also wish to hide 3 directories. I have uploaded a robots.txt file as follows:

    User-agent: *
    Disallow: /images
    Disallow: /Library
    Disallow: /Connections
    User-agent: *
    Disallow: /page.asp
    User-agent: Googlebot
    Disallow:
    User-agent: *
    Disallow: /

    Does this look correct?
     
    TheMrAnderson, Oct 20, 2008 IP