Friends, I have 2 domains, one is .com and other one is .co.uk. Inside my shared hosting, both the .co.uk and .com domains point to the same folder, so my question is: if I upload the robots.txt file will this disallow for both websites? I don't want my .com domain has been index in any search engine. I just want to target my co.uk domain only. Please help to use robotstxt properly for my both domains. I will try this in robots.txt: User-agent: * Allow: .co.uk/* User-agent: * Disallow: .com/* Is it correct? Thanks for all your great support in advance. -Palak Bhatt
if you have co.uk in the links and navigation of website then it will index co.uk just use robots as using only co.uk leave .com aside but u can point to same direcoty for example if some visits your .com and come to main page and then using navingation or links they are following co.uk
Get the ".com" out of the folder and solely make it redirect to the ".co.uk" domain. I don't know which control-panel your hosting provider is using, I can therefore not help you further.