Hi Friends, What should be the crawl rate to be set in google webmaster tool? 3 options are there 1.faster 2.medium( recommended) 3.slower i have seen this message too: "We've detected that Googlebot is limiting the rate at which it crawls pages on your site to ensure it doesn't use too much of your server's resources. If your server can handle additional Googlebot traffic, we recommend that you choose Faster below" Guys! what's your opinion?
"We've detected that Googlebot is limiting the rate at which it crawls pages on your site to ensure it doesn't use too much of your server's resources. If your server can handle additional Googlebot traffic, we recommend that you choose Faster below" If your server can't handle it lower it down if not use full speed.
Manage It accoring to how much you update your site.. If you update after every 2 hrs--> Make Faster If you update daily ---> Medium Else ---> Slower Remember if you are not updating daily and updating 4-5 times in a week , them make it Slower not Medium.. Medium should be only used if your site is updated once in every 24 yours..
I usually just leave it at a standard medium crawl rate - it doesn't seem to make much difference to be honest