I just found out myself, and i think it's cool, so i thought i should share this for the ones that don't know. How it works, you need a google webmaster account, after that you need to verify that you own the site you submitted there. After that go to Tools-> set crawl rate. This is usefull if you have many pages and the BandWidth is not a problem for you. I just set mine to Faster. What they say about this: Faster A faster crawl will enable us to crawl your site quickly, but may put more load on your server. Normal Recommended crawl rate. Slower A slower crawl will reduce Googlebot's traffic on your server, but we may not be able to crawl your site as often. You can do the opposite too, if you don't have BW to spare, just set it to slow and maybe it helps you a little. Ok, this is it, enjoy
Yes, I noticed this many moons ago Isn't it great when you discover something new! Even if it isn't new
haha...well it really is when i found it i said wow...and i was asking myself for so long how to make google crawl faster my site
Actually this option is available only for those websites that are updated often. For example I have a website where are about 15 new pages are created daily (there are about 3300 indexed pages). The "faster" option got available a couple of months ago. While my smaller websites that are updated like once a month, they don't have this option "faster", it is disabled.
Darn pretty old. Good that u finally discovered it. now googlebot will have breakfast, lunch and dinner on your site
This is what I dont understand. Googlebot visits my site every day, I take it it's just doing a routine check. But I noticed on the main overview that googlebot last visited several days ago. What exactly is getting done "faster".
I have had this option available since I created my first site/registered for webamster tools and keep it to fast crawl. I also have one site, which i have not enough time to update the real content, only this on home page/it is even incomplete/, but the crawl rate option is still available.
IMHO, the fast crawl option is only good for websites that update frequently. For a static content site it won't help you. If you set fast crawl for static content sites it will be disabled after some time.
well, the default setting is the best one, so changing it will not necessarily get you crawled faster