Is there a way to tell when the last time google crawled my site? It seems like i have to wait a week or so for the latest changes that I make to my site start making a difference on google search. www.silverstarcabinets.com www.card-racks.com Thanks for your help.
Your webserver logs should tell you when the last time you had a visit from the Googlebot. You can scan for the browser agent of Googlebot although it may be fake. This post should help you tell if it's real or not: http://googlewebmastercentral.blogspot.com/2006/09/how-to-verify-googlebot.html The Googlebot will also check the robots.txt file on every visit as well. To be honest though, Googlebot scans most of my sites each and every day. The webmaster tools has a page within it that'll show you how many pages a site gets indexed each day.
yup Google webmaster Tools is the best....but you can also type this into a google search cache:www.silverstarcabinets.com this will give you a cached version of your site with a date....this will be the last time your site was crawled.
Actually, Google says that if you set your crawl rate, they cannot guarantee the crawl frequency, plus this way will actually hinder your site's visibility more than help it. I use webmaster tools to see how often my site is crawled, it gets crawled every day, so I don't monitor it as much anymore.
Add an XML sitemap It can take quite some time for Google’s crawlers to index all the pages in a new website just by following links. The larger the website, the more time it can take. Pages at a high click depth from your homepage can take a lot longer to get indexed because the crawlers don’t discover them until after several rounds of indexing and link following have occurred. I find that adding an XML sitemap really solves this problem because it tells Google about all your pages ahead of time. If you have a large website with many high click depth pages then an XML sitemap will help indexing enormously.
Create an Google Webmaster Tools account and you can look at the "chart" to see when your site is spidered.
Google's crawling will be traced by google webmaster tool. But not necessarily all crawled links will be indexed by Google. Hope you understand the difference between crawling and indexing. SJ
Make use of Google webmaster tools and eventually you will find it useful on your everyday tracking and updates.
Submit XML site map to the Google webmaster tool is the best way to tell the Google about the pages to crawl.