Hi Guys, I'm really perplexed by something. For ages now my webmaster stats tell me that googlebot last crawled my homepage on the 22 Feb and the cache of the page is ages old. I know the site is being crawled because we blocked the admin page and it reported this back to us just yesterday. So, my question is, why is google reporting that it hasn't accessed the home page since feb, yet it was on the site just yesterday? I suspect its not seeing the home page for some reason, but this is hurting us and causing me sleepless nights!! Any help really appreciated!
i think you should post in these forums like these becuase google will crawl regularly these forums and will also crawl the links in the forum better add your signature in your post and see the result after 6 to 10 days your site will be crawled also check your meta tags and add these tags also <META name="robots" content="INDEX, FOLLOW"> <META name="revisit-after" content="6 days">
You blocked the admin page. Are you sure that's the only thing you blocked? Other questions: 1. How many links from other sites do you have? Directory submissions, blog / forum posts, articles, etc. Perhaps google thinks your page doesn't have any new information, or your server is sending the wrong "if-modified-since" response. Check it out.
I agree with DAbs.. Try to generate links from pages that get visited often. Also chk if you have accidently given NOFOLLOW comand to you METAs.
Definately only the admin site blocked. I think it's to do with our home page url is www.networkutilities.co.uk/metadot/index.pl rather than www.networkutilities.co.uk but how do I get Google to see the first one as the home page?
Will these tags work on my blogspot blog if I add them? I have made my blog on 18th Sep and still it has not been indexed in the google search. I regularly update my blog. Thanks.