Hi, I found out that MSN and Live don't crawl the web often like Google. I have added my web site into MSN 3 months ago. I wanted to see when MSN indexed my website at last and it was still 3 months ago. Google index my website every two days. What do you think about it? ameran
That's right MSN have different algorithm compared to google that's why they are only the number 3 of the top SEs..
Just because your site is not index by MSN does not mean that it does not crawl the web as often. If you search on DP, you will come across threads about MSN spider crawling a site a lot. One of my sites had more hits from MSN recently in May than from Yahoo for eg. Spider Hits Bandwidth Last visit Googlebot 52378+41 1.62 GB 31 May 2007 - 23:59 MSNBot 42088+1623 889.59 MB 31 May 2007 - 23:58 Inktomi Slurp 30871+2128 999.94 MB 31 May 2007 - 23:59
Though I do not see many bots from MSN, hovering around my blog, the crawl status seems fairly decent . Not that I get enormous or extremely large quantity of traffic, but once in a while I do get some considerable amount. Google, by far and wide, the best SE. ~G
I get crawled regularly by MSN, yahoo, and Google. Google was the late comer, but all three have been pretty regular over the past couple of years.
Doesn't AOL use IE? MSN just started coming around for a visit recently. It's good to see them finally make it to the top five of bots on my stats., where as last month they were last, if at all.
MSN should be able to afford a decent 'bot'. Googe is becoming the old 'fuddy-duddy' on the web with their 'sandbox', 'trustrank', etc. Somebody who looks for the new and different on the web could make an impact.