Hi All, I have got some problem and looking for the solution. Actulally two weeks ago i put my website on maintenance mode and using WordPress privacy policy i stop google bot to crawl my website. Now i cant see any indexed page on Google. When i use term site:site.com then it says. A description for this result is not available because of this site's robots.txt " Here is my rotobe.txt file On my google webmaster tool it says that my url is blocked by robote.txt. Now i have change the WordPress setting to all search engine to index the website. But not getting it solved. How long will it take to get index all the pages again.
I'm also looking for solution or idea about website index, Our 6 website just de-index by Google and Pr also loss. How can re-index my website as soon as possible.
Hi First of all remove sitemap.xml from robots.txt as may be sometime before you block this and again there is some problem. Then go for off page activities mainly put your home page link in the blog and forum means on this site for which caching frequency is too high. Sure your website is re-index and cached properly.
You put below robots.txt file in root directory of website. User-agent: * Allow: / And Re-Submit website xml sitemap in Webmaster tool.