Hi, we have just changed all the content of our website, the main domain name has stayed the same but the .co.uk/dshfldhs have changed. Google has stopped crawling the website and returned details saying robot text unreachable. The new site content doesn't have robot text so I think google cant find the new pages. I have submitted a site map but no luck and we are starting to drop down the rankings for keywords and the old .co.uk/dsjfgd details still show in results. What can I do? Will google just take time to find new pages or am i doing something wrong?
create a .htaccess file and redirect Old folder to new. Like redirect 301 co.uk/dsjfgd domain-name/dshfldhs (this is not working for windows server)
There really is no reason not to have a robots.txt file. And in that file you should include the location of your sitemap. Why? Cause the bots are used to looking in the robots file to see where your sitemap is.)