Webmaster Crawl Rate HELP Please

Hello Dpers

I just saw in Webmaster tools that my site was not crawled for 20 days and the faster crawl option is given. So I activated it and it will expire in 90 days.

So, how is it calculated when to give the option of faster crawl? After 90 days when will I get the option of faster crawl?

Waiting for replies
Bubai pal

 

there are some factors that will give you the option of faster crawl like how fast your server and internet connection to your hosting.

 

I don't even use the faster crawler rate on my sites. Fresh content daily is a good way to keep search engines crawling your sites.

Well if your server can handle faster crawl rate, then by all mean's use it. If you are on shared hosting, don't even bother with that option cause you never know how stupid your host can be.

 

I am giving it a try as my site has not be crawled for 20 days. No option for me. But the server is very slow.

 

Just add a fresh page of content and a few links.

 

another way to get google to come back sooner is to add a Word Press blog to the site, so www.yourwebsite.com/blog

On the blog have a link to the main page and in the blog talk about and post internal links to other pages on your website.

Using this can help Google come back often.
As well as adding fresh content to the website, also you can skip the blog if you can add rss to your site.

 

No need for faster crawl, just have unique content and the search engine bots will come

 

If you add or update your site more often, then you will get this fast crawl option..

I have 3 sites, all are set to faster crawl.

 

Update your site, add links. Your site will then be crawled every day.

 

Do you have a sitemap created for your website? Lot's of useful information posted already.

 

I think an RSS feed of free syndicated content would have the desired effect of creating constantly updated content.

 

The speed of the crawl is not the same thing as the frequency of the crawl, they're completely different things.

 

i think it's related with the dailly downloaded kb from your web site

 

I am unsure how often that page gets updated.
My webmaster tools says:
"Googlebot last successfully accessed your home page on Apr 4, 2008"
So it has been over a month for me. But, If you have a look on the "set crawl rate" page, it says
"Googlebot activity in the last 90 days" and
"Number of pages crawled per day" etc...

That sounds to me like Googlebot is going to my site every day, but Webmaster tools is not updating the information on the "set crawl rate" page every day.

I wish it would update more often, but its a free service, so I guess I can't complain

I am not 100% sure if what I just said is right, it's just what I think.
So if anyone knows if that is wrong, please tell us.

I have only had the option to increase the Googlebot crawl speed once. That was a month or two after I started my site.. I have not had the option since then. (about a year)

Cheers
James