We changed our site layout and made new URL struckture almost 3 months ago and still Google haven’t been indexed most of our new pages of our website (www.medemis.ee). We tried to wait as sometimes Google may just need to work things out itself. It can take time but now we have been waited over 10 weeks and still only under 10 pages indexed of 82 pages. We have submited sitemap to Webmaster Tools and it shows URLs in web index is 1. Tried to change crawl rate (page loading speed looks to be OK), we set now even crawl rate to 20 seconds between requests, to be sure. Server seems to work nicely, header respons seems to be ok, or not? Struckture seems to be OK, SEOMoz softwares seems to tell that everything is OK also. Only some little warnings that will be fixed when we get all translations. Our Domain Authority is 31 (SEOMoz) so I think there should be no problem to index 82 pages. We haven’t change our site much during last weeks but Craling stats were normal firstly, but now they seem to be going down. Graphic is here: www.kehaehted.ee/crawl/chart.png. We even send it Google reinclusion request and got for a answer this: We've processed your reconsideration request for http://www.medemis.ee/ We received a request from a site owner to reconsider how we index the following site: http://www.medemis.ee/. We've now reviewed your site. When we review a site, we check to see if it's in violation of ourWebmaster Guidelines. If we don't find any problems, we'll reconsider our indexing of your site. If your site still doesn't appear in our search results, check our Help Center for steps you can take. Strange thins is that first we have some redirect problems and Google didn’t index any of our new pages but Bing/Yahoo did and still has most of pages indexed. No problem there, we rank well. Second thing is that our non-www version has much more incoming links and WT Preferred domains function is set Display URLs as www.medemis.ee. Yahoo/Bing shows mostly www versions of URLs, indexed. But Google shows mostly non-www versions and our non-www versions are redirected with 301 to www version.
Why would it explain that Bing indexed new pages over 2 months ago and Google doesn't. For example Estonian language home page www.medemis.ee/est/ has over 10+ strong linke from different root domains and still it doesn't get indexed. About sitemap? Like I said "We have submited sitemap to Webmaster Tools".
only thing you can do is place your page links on high traffic sites. but still google makes their decision on how often to crawl and index pages on their own.
Here is my suggestions 1. You should have only one version between www and non-www version. This will benefits you in a long term 2. You may consider build deep links to many inner pages helping Google index your pages a lot faster. Article marketing may be your choice in this case. 3. Pay attention on the type of links you acquire. A lot of bloated sitewide links may harm you in a long term.