View Full Version : Robots.txt for parked domains
Johnny_D
Apr 28th 2008, 12:29 pm
I have a small problem
i have a site : mysite.com
Also i have my-site.com parked on mysite.com. How do i restrict my-site.com from being crawled ?
Please anyone...10x
j4l4ni
Apr 29th 2008, 7:35 am
i dont have idea for that. :( sorry..
RankSurge
Apr 29th 2008, 8:26 am
on your robots.txt page:
User-agent: googlebot
Disallow: /
and if you have a page for that site and you want to prevent any indexing:
<META NAME="revisit-after" CONTENT="never">
<meta name="robots" content="noarchive">
<meta http-equiv="pragma" content="no-cache">
<META name="VIEWER-GOOGLE" content="NODISPLAY">
<META NAME="GOOGLEBOT" CONTENT="NOARCHIVE">
angilina
Apr 29th 2008, 11:11 am
Use the Robots.txt file to do it.
Read this
robotstxt.org/faq/prevent.html
vBulletin® v3.6.8, Copyright ©2000-2008, Jelsoft Enterprises Ltd.