Why is Google spidering so few pages on our site. We submit a sitemap with >10,000 pages and have had >13,000 pages in Google's index as recently as last week. Is there something wrong with the structure of our site that is causing it to lose cached pages? The website is http://www.bytemycode.com and it has the user-generated content that Google usually loves. Thanks, Lenny Grover New Media Properties LLC
The content is unique and the gzipped sitemap is not linked to from our site (though it is registered with Google). Other similar sites see tens of thousands of pages listed with roughly the same amount of unique content that we have--the spider just does not like our site. Where should we point links to see the best spidering of our site?