On accessing Google Sitemaps recently I saw an option to adjust the crawl rate from normal to the faster rate. This would apparently allow the site pages to be indexed more quickly. When I selected this option a message then appeared stating “A faster crawl … may put more load on your serverâ€. Does anyone have knowledge or experience of the levels of increased load on the server which that a faster crawl rate can produce? Whilst there are obvious benefits to the faster crawl rate, a significant slowdown in server performance would be too higher price to pay.
We have hosted one of our website with 1and1 and checked faster crawl option in sitemap tool. See, the hosted server performance is very important. Now we are enjoying in top positioning. The Google crawl much faster than before.
No problems with a faster crawl rate. I've also seen a general improvement in the SERP ranking, but of course that could also be due to the hard work I'm doing
The fast crawl option is greyed out in my webmaster page on google. Does this mean my site is new and what will it take for me to be able to use this option?
You can select the faster crawl rate option if you update your contents on a daily basis. If it is once or twice a week, then leaving the crawl rate as such is the best option, imo
Thanks for the comments. I have selected the faster rate and things seem to be holding up just fine. It's good to talk. Simon
Grrr. Faster crawl rate isn't available for me at the moment. It would have been useful since i've tried to seo my site. Oh well. Slowly but surely.
I don't think the server load increases THAT much using fast crawl rate. But it's probably only worth it if you update your site very often.