Can't believe how far Google has moved forward. Posted something 3 min's ago in Sitepoint and it's already showing up in the Google results for that post. Maybe my forums get crawled that quickly for new posts or hope it does lol.
That seems pretty fast, if you look at it the other way though, Google is so big that I'd think they should be able to index rather fast...
Well sitepoint and dp are the forums that can be really crawl fast then they would be index already. I used dp and sitepoint on a daily basis to make my backlinks and being crawl right away .
It happens! I sometimes have had the same thing happen on my forum to. I have made a post and got it not only indexed but on page 1 for the search term in less than half an hour to!
Yeh even DP and other large forums get indexed very quickly. Wish it was the same for other smaller sites
Strangely my forum is not a "Big Forum" nucleus99, go figure that one LOL Though it is a few years old and in the old Alexa system was in the top 100,000 sites worldwide when on SMF about 5 years back B4 we lost our database (plus 1000 plus memberships) and then moved to VB
I can write a post on either one of my blogs and it will be listed within a minute.... Google is good indeed.
Yeah, the threads on this forum index fast as well. I prefer DigitalPoint instead of SitePoint, though. Yugo,
Google crawls certain sites nearly continuously. It's a matter of priority. Big sites are continually generating content and Google wants to keep up on what is new.
OK that said why is it on one of my sites almost every hour (and as for Yahoo slurp - boy I wish I could slow them down - I have tried all sorts) as can be seen here > http://tvworlds.com/forum/online.php It's not a big site, it's not busy and it's by no means important and getting accepted as a member you have to jump through hoops for, yet the darned spiders just won't leave the site alone! What do you reckon? I sort of know already but others ideas are always interesting to hear to. And when I say on there all the time - one day there we're over 140 Yahoo Slurps on at the same time!
Happens for some forums, some blogs too and although im not a twitter user i quite like how google have included the realtime twitter stuff in their search results. Bring on the realtime or nearly realtime.
I saw posts in digital point indexed with in a minute.. Try posting something in Google or Adsense subsection and check its indexing status within a minute.
Well I guess google knows which forums they should crawl as often as possible because most of the time they deliver worth for the users
This happens not only with sitepoint but also with our DP and with all the leading forums. Google easily index them immediately.