Another Urgent Help. Robots.txt??

Hi Guys,

I have another question.
My client's website have an old website that has a "www" that is redirected to it's new domain that is a "non-www". I want the old website not be displayed on search results. I don't want it to be crawled bt all search engine crawlers

 

Normally, one would use a 301 redirect of the old site (homepage and its pages) to the new domain and allow time for crawling. Also, the Change of Address option would be used in Google Webmaster Tools. Then the old domain will be removed from search results. If you want to redirect, but not for search engines and just tell them not to crawl, you risk penalty on the new site (you would need to use a form of cloaking).

Why do you not want the old site to be crawled? That's kind of senseless if you are redirecting. If it's due to penalty concern (redirect passing on the penalty), then don't redirect and just add a robots.txt file.

 

301 your old site to your new and use the NoIndex option in the robots.txt

 

You need to optimize your Robots.txt file
Check this code

User-agent: *
Disallow: /wp-admin/
Disallow: /wp-includes/

Simply disallow the folders u dont want to show to search engine bot

 

in your old website
robots.txt write

User-agent: *
Disallow: /

that is enough