did you know that you can change the crawl rate for your site in google?

I just found out myself, and i think it's cool, so i thought i should share this for the ones that don't know.

How it works, you need a google webmaster account, after that you need to verify that you own the site you submitted there.
After that go to Tools-> set crawl rate.

This is usefull if you have many pages and the BandWidth is not a problem for you. I just set mine to Faster.


What they say about this:

Faster A faster crawl will enable us to crawl your site quickly, but may put more load on your server.
Normal Recommended crawl rate.
Slower A slower crawl will reduce Googlebot's traffic on your server, but we may not be able to crawl your site as often.


You can do the opposite too, if you don't have BW to spare, just set it to slow and maybe it helps you a little.

Ok, this is it, enjoy

 

Yes, I noticed this many moons ago Isn't it great when you discover something new! Even if it isn't new

 

haha...well it really is when i found it i said wow...and i was asking myself for so long how to make google crawl faster my site

 

yes - i did know that!

 

Actually this option is available only for those websites that are updated often.
For example I have a website where are about 15 new pages are created daily (there are about 3300 indexed pages). The "faster" option got available a couple of months ago.
While my smaller websites that are updated like once a month, they don't have this option "faster", it is disabled.

 

Darn pretty old. Good that u finally discovered it. now googlebot will have breakfast, lunch and dinner on your site

 

It's a great trick, very necessary imho.

 

This is what I dont understand. Googlebot visits my site every day, I take it it's just doing a routine check. But I noticed on the main overview that googlebot last visited several days ago. What exactly is getting done "faster".

 

I have had this option available since I created my first site/registered for webamster tools and keep it to fast crawl. I also have one site, which i have not enough time to update the real content, only this on home page/it is even incomplete/, but the crawl rate option is still available.

 

lol....i see everybody knew, so am i the last one that found out about this ...

 

ohh i dint know that...

Thnx for the tip

 

Weird... i have it disabled for a couple of my sites

 

i didn't know it, thank's for the information budy

 

IMHO, the fast crawl option is only good for websites that update frequently. For a static content site it won't help you.
If you set fast crawl for static content sites it will be disabled after some time.

 

well, the default setting is the best one, so changing it will not necessarily get you crawled faster

 

well, i never knew, so thanks

 

Same here, but I've also set a couple sites to "Faster", and have seen no increase in bot visits...

 

yes, i know it . it was mention before but thanks for reminding it again