I have a small problem i have a site : mysite.com Also i have my-site.com parked on mysite.com. How do i restrict my-site.com from being crawled ? Please anyone...10x
on your robots.txt page: User-agent: googlebot Disallow: / and if you have a page for that site and you want to prevent any indexing: <META NAME="revisit-after" CONTENT="never"> <meta name="robots" content="noarchive"> <meta http-equiv="pragma" content="no-cache"> <META name="VIEWER-GOOGLE" content="NODISPLAY"> <META NAME="GOOGLEBOT" CONTENT="NOARCHIVE">