Hello I am trying to slow down the time googlebot visits my pages (as i am beeing hit pretty often by it and it is consuming bandwidth, cpu and memory). I tried using the "Crawl-Delay: 3600" but it seems like googlebot is ignoring this. Do you have any other suggestions on how to slow it down?
I wouldnt bother unless it's visit frequency is likely to use all of your monthly bandwidth allowance. If it does look like it may use all your bandwith this might help
Sign up for google sitemaps. Add/Verify your site. Under "Crawl Speed" select slow. http://www.google.com/webmasters/sitemaps/
I am already signed up for google sitemaps. I was under the impression that this was disabled and not working. I am using the page in swedish and it says something like below (free translation as it is in swedish in my page) Currently the speed of the search has no meaning for how fast we crawl your site, if it will have any meaning in the future we will enable the option faster crawl. Maybe i have missunderstood it and it is only the faster crawl option that is not currently working?