Hello, I need some help or suggestion with the indexing of my website. My website is something like mybusiness . com I have this redirected to a subdomain of the platform I use. Something like mybusiness.someplatform .com The problem is both mybusiness .com and mybusiness.someplatform .com are getting indexed. I do not want this sub domain to be indexed. If I block it at the robots.txt does this effect my main url crawling too? Please help. Thanks
You should use wilcards to do that, so on the root of the main domain add it to your robots.txt file Disallow: /*&subdomain.domain.com hope it help
Hi Jagan, if I am correct you have redirected your main domain to your subdomain due to some specific reasons and if you have done it, it doesn't make any sense to block the sub domain from search engines, What you should do, use following robots.txt for your main domain: user-agent:* Disallow: / once you are done with it, remove all the indexed URL of main domain from Google Webmaster tools. Now your all main domain URLs are out of the index and now you can use your subdomain