Dear friends, How do I prevent Google or any other search engines from spidering my download page? While I only want google to index my content pages, I wouldn't want google to be indexing my download page for my Clickbank product. Thanks in advance, EL
You need to have create a robot.txt allow or disallow robot to find that page or folder. upload to your root. # robots.txt for http://www.example.com/ --------------------- User-agent: * Disallow: /cyberworld/map/ # This is an infinite virtual URL space Disallow: /tmp/ # these will soon disappear Disallow: /.html ----------------- hope this help..
or use rel=nofollow or Javascript on the link. ContentHub, I'd beware of the robots.txt example above because I'm not sure xAlexKimx knows your site's structure. Could really mess indexing up for you. Read up on robots.txt before adding it to your site.
Hey guys, Thanks for all your suggestions. I will probably try out adding the meta tag, as suggested by seo ranter. Really appreciate all your quick responses, EL