Noticed something interesting about Google. Wanted to see if any of you guys have ever experienced this and/or might know what it means. For a while there, the front page of my website was being indexed more than a dozen times a day. Then, for a couple of weeks, the front page was no longer being indexed, even thought other content was still being picked up. Google is now doing it again, where my front page is indexed rather rapidly and frequently each day. Any ideas on what is going on?
Google tends to crawl when you let them know something has changed, for instance pinging a blog post to Google after a blog post has been created may get spiders crawling again. Updating your index page, again presume it's a blog, when you post, the new post may go to your index page & Google will crawl the new content. If you submit a link somewhere or someone else does, again the spiders may find the link & go back to your site. The more regular the changes on your site, the more often Google tends to crawl back.
Yeah, my update frequency is at a pretty high rate. I figured that's why the front page is indexed that often. I was curious about why they stopped crawling the front page (other pages were crawled regularly) for a couple of weeks before starting up again.
I thought we could set how much value for which pages bot will come in sitemap. Do you have sitemap ?
I now have a sitemap, but I'm not a big believer in them. I'm able to get indexed and crawled at a high pace without it. I think I only put a sitemap up recently because I figured it couldn't hurt. I only have a fraction of my links on there.
Some of my friends believe on such things too. So im understand what we are talking about. But you just mention a Google at the first time. SERP, Analytics and Webmaster is a tool in 1 kingdom which can be used in order to play with a stuff, website. If you have ignore it, why you cares about Front page updating frequency ?
I care about stuff like this because I'm trying to learn and trying to get a better understanding of Google. Some of this stuff might be able to help me improve as an SEO guy and help make my site perform better.