Hi, Two month ago, I created a new website. At first everything worked fine, and all my pages were in Google's index. After 2, or 3 weeks I noticed that all my pages were dropped from Google index, because the robots.txt, changed somehow it's content and blocked Google's robot. Since then, even though I changed back the robots.txt content how it was before and I tried getting new links to the site, I still can't get Google to re-index my site. What do you suggest I should do?
I have faced the same problem with you. The best way should be create a XML sitemap and reindexing your all pages. Just try it!
As the other guys said, create a site map AND submit it to google webmasters. Register your site there, submit the sitemap and that's it.
Hi MadMan90. Are you sure that the robots.txt file is correct? In Webmaster Tools fetch the page with "fetch as Googlebot" to see if it fetch's. Also make sure your meta tags are "index, follow" and check your header response for 301 redirect or meta refresh redirect's. Post the URL I will check it out for you. Regards, knysna
Check your robots.txt file. Mot much we can do really since we don't know how you configured your robots.txt file.
This is the url of the site: http://footballfielddimensions.org/, I have submitted the site sitemap to webmaster tools one or two weeks ago, but with no success.
Here is your problem. You are blocking the spider with your robot meta tag in the head section of your document (index page) -- meta name='robots' content='noindex,nofollow' / you need to change it to index,follow
This things can be modified, by other users, because I know for sure that I didn't made that, and the robots.txt just appeared after two weeks of the site release?
Then if I was you I would change my password and login information. You might have some gremlins perusing around.
Yes that was the problem. But do yourself a favor and go to Webmaster Tools and fetch the page with "fetch as Googlebot" then send it to index. That might speed up the process, other than that you'll just have to be patient and wait for the bot to notice the index meta tag. Good luck. Regards, knysna
Hello MadMan90, I have checked your site. now follow the mention steps: 1. edit your robots.txt file change to User-agent: * Disallow: 2. login your wp-admin section and go to settings>Privacy there select the first option - "I would like my site to be visible to everyone, including search engines..." 3. then go to webmaster tools and select the option "Fetch as Googlbot" and Fetch. your site will re-index with in 24 hours.
Hi aniket123, Thanks for your reply. I just did all the above steps, although step 2 I did it 2 or 3 days ago. Have a nice day!
Hi, I just got 2 pages indexed by Google. This just made my day... Thank you everyone for all your answers and for helping me resolve this problem. Have a nice day!