we know that google crawl rate can be set at google webmaster and since I using google webmaster for my website, I always using standard /default crawl rate. anyone custom crawl rate for your website? if yes, what do you feel the different for your site?? thanks
Googlebot uses sophisticated algorithms that determine how much to crawl each site. Our goal is to crawl as many pages from your site as we can on each visit without overwhelming your server's bandwidth.Crawler rate use every search engine to crawl their website.
thats a request made to them, but I think they use their own computations to determine how often to crawl a site.