I have notice from few days my website index rate suddenly going down. my site contain 2.5 million pages and i have set Google crawl rate maximum in webmaster tool after it Google index my pages continuously when it reach around 13 lac suddenly Google index rate going down and day to day it show decreasing now present it show 12 lac's only. in between it was reset Google crawling rate. and Google show 90 days period for indexing all pages. i don't know what happen in Google indexing please guide or any suggestion for it.
How about your content? Remember that Panda is hunting all non-quality content sites down... hope it's not your case.
Hi myindiahub, Google crawl rate is one of the most important thing to check if you think you're penalized. I think you've made something wrong and Google decided to take some actions here... here are some clues of what can cause the decrease of Google crawl rate : - Duplicate content - Spamdexing - Spam - misuse of link rel=canonical - misuse of robots.txt - wrong redirect (user-agent) cloaking - to many 500 or 400 http error type if I had your website url, I could have made some research... Best regards, Gabriel Jones,
damn i cant take this anymore im in the second page of google with my main keyword and when i wake up next morning i lost all my indexed posts and pages including my main site in google i dont know what happened
Maybe you should pay attention to pages have duplicate,Google will remove the pages it thinks as duplicate.
Changing your crawling rate does not impact crawler's visit on your website. Manual adjustment in crawling rate lasts for 90 days. I think duplicate content is reason for slow crawling of your website. Other alternative, add a good Sitemap on your website or use your RSS feeds as your Sitemap. Make sure, you have good internal linking structure of your web pages.
Google doesn't agree to index all pages of a site, especially one of 2.5M pages. As it get's an idea of what the site's about, I imagine crawling could slow as it starts to pick and choose where it's going.Also resources and connection speeds vary. Thank you.
In 30 days time, we saw Gogole indexing more than a million pages from our website. But suddenly for the last 10 days we see there is slight drops in the number of URL in web index shown by Google webmaster tool. To be precise it indexed about 1.2 million pages in 30 days and in last 10 days it dropped about 80,000 pages. We are little concerned about the decreasing indexed count. Any body have similar experience or would really appreciate if someone can help us understanding this. I don’t want to share my site in public so any one serious can mail me newtrend19[at]gmail[dot]com
I have had a similar problem, I don't have 2 million pages, but I do have about 200+ back links, dropped from position 3 on page 1 to postion 4 on page 5 ! Is back links the key? cocoonfxmedia.co.uk I have also made changes last week and I seem not to be able to get google to re index the site... !!!