Let's say i have a site: mysite.com and an add-on domain: myaddon.com (which is actually myaddon.mysite.com) I assume, if I don't post the subdomain link anywhere it is not indexed as subdomain, true? This is the real issue: Since I have a folder mysite.com/myaddon search engines normally index that directory as well. Should I disallow this with robots.txt? Sould this disallow effect the indexing of the add-on domain? (I assume not) Thanks.
That's right. Only if there is somewhere a link pointing to it. As you cannot be sure there will never be a link to a "bad" URL, there are two possible approaches: - robots.txt to disallow access to URL's you do not want to be crawled; - .htaccess to redirect any access from a "bad" URL to a "good" URL. robots.txt is the best solution if there are no important links pointing to the "bad" addresses; .htaccess should be prefered otherwise. Jean-Luc