Recently, I put up a new site which I REALLY need indexed, as a result I have built over a hundred unique backlinks etc. The thing is, my site was down for about 3 days due to hosting problems and now it just can't seem to get indexed! I checked webmasters/tools and it said the URL was unreachable because robots.txt cannot be reached. So I figured I would just upload robots.txt to the root of my site and that would fix the problem. However, it hasn't. This has never happened to me before and my sites usually get indexed within a day or two at most. Altogether it's been about two weeks now.
I think you should change your host if such problem is persistent. Try to add fresh content and also use sitemap, hope google crawlers will come back soon.
Yeah, I was in the process of changing hosts when this happened. I can't really add fresh content, because well it's a salespage.
Haha, it's not that easy. Anyway, I did some research I fixed my robots.txt file and put the crawl rate up in webmaster tools. Also added this to the index file. <meta name="robots" content="index,follow" /> Should work soon.
I do not think just your site being down for 3 days would be the sole problem for your site not being indexed...It could be also your immediate obsession to link building. Go slow with the new site on link development and try to make this effort look as natural as possible and avoid doing anything in a hurry and in one go... Haste makes waste! Regards, RightMan
Hi Pimpinkid, You can actually add fresh content even though your site is a sales page. Install a blog on your subdirectory (http://yoursite.com/blog) just for the sake of getting your site indexed fast. Then ping your blog using pingoat.com Hope that helps!