Hi guys, I have been searching for a solution for my problem, I'm sure it's out there but I can't seem to find the correct wording to find it online, thus my appeal to you. I recently created a wordpress blog for my companies website, which i put for testing on home/newsletter Having not linked it to any other page I wrongly assumed it would not be indexed by google, and proceeded to upload all old posts to it. However when I moved the finalized version of the folder to: home/resources/newsletter I started getting TONS of 404's from google webmaster. I wanted to put a no index in robots by putting disallow: /newsletter however given the second directory is ALSO named newsletter, this would prevent bots from indexing it... So my question is:... how do I disallow home/newsletter but allow home/resources/newsletter Thanks a lot guys!!!
Hi sebastien, To answer your second question in robots.txt, just add User-agent: * Disallow: home/newsletter The only problem is that google already indexed that page, and might still be on the internet. The best thing to do would be if you have google webmaster account, is to that code within robots.txt and remove the from google webmaster tool. Someone from google will remove it. Or you just perform 301 redirect if you have an apache server running and it's a link put this in your .htaccess redirect 301 /home/newsletter url.com/home/resources/newsletter. I think this is the most likable solution Joey
In the robots.txt, add: User-agent: * Disallow: home/newsletter Allow: home/resources/newsletter Code (markup):