Crawl rate

Hey there,

Lately I noticed that to every domain I add to my Google Webmasters Tools, I can't set the crawl rate to "fast". It says the crawl rate is not currently a factor. Do any of you know what could those factors be?

Thanks,

 

that they already crawl a lot for your own site? thats a big factor, google doesnt want to over crawl a site and take away bandwidth and etc.

 

My site has 207 pages indexed in Google so far. It's 1 month old.
I don't think they are concerned about sucking up my bandwidth since actually this is an opt-in setting I'm modifying

 

recently one of my site got the faster crawl rate option available, i guess the rate of adding new pages to a site is probably the main reason for this fast crawl option's availability!!
so, if google finds that too many new pages are added daily, they may give you the option

 

I have just added a translation plugin.
http://www.trendplex.com

This should multiply the number of existent pages by 10
I'll keep you posted, thanks.

 

i guess unique content is what is required!
my site is a social networking website with huge traffic, so i have a lot of member profile pages

 

I just bumped mine up to fast as well. If you have the bandwidth or your site is not that big, the faster the crawl the better.

 

Fully agree.
However, the unique content is not a criteria on my website. Let's see what happens in the future.

 

The faster the crawl from googlebot the better? I would think it would be the other way around. I want google to take time on my site, find everything relevant to my niche and content, but that's just me I guess.....

 

Thats not how it works, Google bot can stop crawling you webpage if it thinks its hogging up too much bandwidth. Hence it goes into slow mode and only crawls a few pages and then goes away to not cause too much strain.

Googlebot will then come back at a later time to resume. If you have the normal or fast bot Googlebot will crawl and spider as much of your site each time because it knows you server will handle it and will index those pages it finds instead of only doing a few an the going away.

 

Google switches to fast mode when:
1. the site is big enough
2. changes quie often
3. is somewhat valuable to Google.
Theeese 3 factors work together, any 2 of them won't get your site indexed in fast mode. Look at the crawling rate as not a reason for good SERP positions but a consiquence of a strong, big and authentic site. I can share my thoughts on it if anyone's interested.
This is IMHO as anything I say is

 

Google Doesn't Take To Much Bandwidth. Even Is If Crawled Thousand Of Time A Day. On Mine Anyway.

 

Thanks again for the latest tips.

 

Agreed,
I have 2 sites A and B, both only about 25-28 pages (very little contents), both are 3 months old
site A: Doesn't has option to crawl faster (added new page once in a while, little bit by little bit, one by one at random rate)
site B: Does had option to crawl faster (added 4,5 or 8 new pages at one time then quit then another round and so on)

 

hmm fast crawl is an interesting feature but I don't know weather it works for me or not. Because google crawls mine every 3-4 days for around 6-7 hours a day

 

read this reply http://forums.digitalpoint.com/showthread.php?p=3489247#post3489247