I've heard that Google sends its spiders out near the 30th of the month. Does anyone know about the same for Yahoo! and MSN? Thanks.
Forget about Yahoo, they update when they feel like it. I did a modrewrite on my main site several months ago... yahoo still shows all the old urls for every single page it has in its index.
i have read in some forums that blogging and pinging brings yahoo and google spiders to the website. isnt' true then ?
Blogging can bring inbound links to your site if you do it right. This can help bring spider is more frequently simply because there are more links on the web that they can follow to your site.
Yahoo's spider visits my site every single day, that is not the problem, the problem is that the index still shows pages from 3 months ago
That is the same problem with me....They eat my bandwidth like anything. But indexed pages are two or three months old.
Yahoo is schizo.. I have been going back and forth with one site for a while now... They have at least two distinct sets of listings and one is rarely updated.. I can flip back and forth and have 50% of my pages show from one second to the next, and the smaller numbers are all very old. Then I just looked up another site and all my pages disappeared. Yahoo seems to really crave a lot of attention.