search engine specific robot.txt [HELP]

Discussion in 'robots.txt' started by cloudseoguy, Aug 19, 2012.

  1. #1
    just wondering if there is a way to allow select search engines to crawl specified pages on my site.

    say i want google to crawl my index(home page), store, and contact page.

    and want bing to just crawl my index.

    and disallow minor third party search engines from crawling anything on my site.
     
    cloudseoguy, Aug 19, 2012 IP