Hi guys, I've been running my website for over 3 years now - www.dvd-subtitles.com. I have over 30,000 DVD pages, and despite being intensively crawled by google, only around 500 DVD pages appear to have been indexed (checking with "site:www.dvd-subtitles.com" in google search). The pages that have been indexed do extremely well, usually 1st or at least in the top 5 results, for example try googling "subtitles for constantine". Why doesn't google index all my pages? is it because I don't have enough inbound links to those pages? What can I do to resolve this? MSN search only has 182 of my pages indexed Yahoo has about 12,000 Any suggestions or advice greatly appreciated! Cheers, Mat
I have the same problem with my site.... do you think that http://www.mysubtitles.com site is a problem for google?
As per mine knowledge with Google is every day crawling million of new sources. Crawling and indexing are processes which can take some time and which rely on many factors. In general, we cannot make predictions or guarantees about when or if your site URLs will be crawled or indexed. Keep in mind that while a Sitemap file can help us learn about your site, it does not guarantee indexing or increase your site's ranking. Also Google isn’t given any guarantee to crawl thousand of pages at a time but it will try to crawl through sitemap.
just viewed your site on Google with site:www.dvd-subtitles.com and it comes with "0" pages, but when I Googled with site:dvd-subtitles.com (without www.) it's showing 7,410 results. So, the problem is with the URL structure of you site and it is set without the WWW. You can also notice one point, just open your IE and copy paste www.dvd-subtitles.com and you can see when the site loaded it becomes dvd-subtitles.com You can resolve this problem very easily with Google Webmaster Tools. If your site is already added on GWT, just change the URL structure and the problem will be resolved with 24hrs.