I saw offers to linking your site to daily spidered site. Is there any way to make your site to be spidered daily or at least more frequently? thanks
It is believed that sites with changing content and with higher PR (= more backlinks) are spidered more frequently.
Duh, why would you want spiders visit your pages daily? you think its a good thing?? Spiders are killing me. one of the most trafficed sites they are utilizing around 5 GB of bandwidth every month. I am trying to control them visiting my sites over and over...
You can submit a Google Sitemap to tell them how frequently each page on your site changes -- suggesting that they should visit your site that frequently to keep up with your changes.
agreed with the webamaster! spiders consume a lot of bandwidth so i think for a site its fine if they visit after 48 hrs and in case of a news site or blog it should be more frequent! i think G is smart enough to estimate the frquency of updates on a certain page!
I normally submit my sitemap with 1month frequency of change because my content doesn't change that often.
The is no need to have Google spidered your site on daily basis. If you site have a modular content, yes it's good. But majority of internet sites are basically static data. Anyway.. the content should be the original ones. No duplication or your PR will drop.
Ok now this is something interesting, whats the recommendation for spidering your blog that gets some 50-60 Uniques daily! Will spidering it be helpful? and how do we get it spidered? What about Pings?
Get your website updated frequently and the googlebot should be visiting regularly. Also, you'll need a high number of backlinks (pagerank if possible).
I completely agree . Being crawled frequently does not mean you’ll rank faster on your targeted keywords or any keywords (if your site does not update regularly, well daily crawling is unnecessary)