Hi, I'm new to robots.txt I have several domains on the same host. Everything is hosted at www.myfirstdomain.com So for example www.myseconddomain.com points to www.myfirstdomain.com/myseconddomain.com I don't want the search engines to list my site on www.myfirstdomain.com/myseconddomain.com only www.myseconddomain.com Is that possible?
Not quite sure what you mean. Are you saying you've got a redirect in your .htaccess that redirects myseconddomain.com to myfirstdomain.com/myseconddomain/ but that you want search engines to list myseconddomain.com?
Sort of, but not quite. I don't have a .htaccess redirect, but I have the domain registered at godaddy.com and the host is at fxdomains.com So over at godaddy.com I have to type in fxdomains.com two nameservers, and at fxdomains.com I have to tell it to accept www.myseconddomain.com (which is hosted at godaddy.com) and show what is actually on www.myfirstdomain.com/myseconddomain.com So when I type in: www.myseconddomain.com and www.myfirstdomain.com/myseconddomain.com It will show the same things, but I only want the real domain name, the first one to be listed on searchengines, not the second one, where it's hosted. Gah, I'm making this sound more complicated than it is >_<
Hi, Just include this in robots.txt of myfirstdomain.com: User-agent: * Disallow: /myseconddomain.com Code (markup): Jean-Luc
you must the name of folders to your robots.txt file. if your second domain is inside the x folder, you must add Disallow: /x/$ to your robots.txt