I am launching a new site specifically to Google and do not want to be penalized by the other search engines that I have top ranking on with another URL due to duplcate content. How can I wirite this to exclude all spiders, but allow only Google to spider my complete site; <meta name="ROBOTS" content="ALL"> <meta name="revisit-after" content="7 Days"> Thanks, Jack
The all tag isn't needed, that's the default. the revisit-after isn't a good idea unless you've got a site that's getting eaten up by bots and don't update the site often (your telling the bots not to come back for a week). You'd be better off disallowing Yahoo and MSN and being done with it.
Mdvaldosta, <meta name="ROBOTS" content="ALL"> <meta name="revisit-after" content="7 Days"> These tags are on my current site that has top ranking on Yahho & MSN, I thought this was correct but your input would be greatly appreciated. I am asking how to write the above tags to keep Yahoo & MSN from spidering a new site that is strictly for Google. Thanks, Jack
this tells the bot to only visit you site once a week, not a good idea if update your content regularly
You will probably need to restrict yahoo and msn with your robots.txt file. But i dont think it is necessary to do all of that. If one of the SEs considers this site dup content - that SE will just ignore your content.