I am new to wordpress, still learning. I downloaded a theme, added some content and thought the site was running okay. I did a press release, articles, and started building backlinks. I kept checking google and I wasn't indexed and couldn't understand why so I did some checking and somehow the robots.txt was blocking the site, so I changed it and made a google xml sitemap went into google webmaster tools and submitted it. Now when I look google says success for accessing the robots.txt and shows 13 urls but there is no site: or cache: in google and it has been almost a week. Do I just need to wait it out? Will I eventually get indexed? Any other suggestions? This is for the tanning lotion site in my sig.
Your robots.txt doesn't look right, try: instead of I'm not sure if it make a difference but never seen a robots.txt with just the one line before.
Thanks I fixed it. I had it like that and I just removed the disallow all together since the I had disallow /
Try to get more backlinks, specially from here DP As well as get some more bookmarks. You will get index soon, However, when I search for site:bestratedtanninglotions.com, I have got one result.... So, get more backlinks.
If you used a robot.txt to tell google not to index your site IMO it will obey this for 90 days and come back. Just get more links in to each page of your site.
If you do site:bestratedtanninglotions.com and click contain the term you can see that I have submitted articles, a press release et. Of course I will still continue to build links. 90 days is a long time to wait. Oh well at least I learned a new lesson. Thanks to all for the help
Wordpress blogs have a privacy setting where it will generate a robots.txt with disallow and also use meta noindex attribute. Just clearing the robots.txt may not work sometimes.
ah good point, You have this in your code <meta name='robots' content='noindex,nofollow' /> Thats the problem.
Good your matter is solved, for any info on Robots.txt, check the following article, i've explained about it in detail and explained how to set it up in easy words : What is Robots.txt? How do i use it? What does it do?
Found it under privacy settings in my dashboard. It said block search engines. Again thanks for catching that!