Now MSN also supports this sitemap via auto discovery on robots.txt. Just put Sitemap:http://www.allseocontest.com/sitemap.xml on your robots.txt and you are set to go.
Thanks for the info and I will try that.. The presence of a robots.txt file lately has been seen to be highly important to the MSN robot’s crawls, and MSN has been known to completely disregard sites that don’t incorporate the robots.txt. Whether this is part of the new neural net or simply a filter, we can’t be certain.
Great hopefully it will work and not destroy my sites rankings, you can never tell with these new Microsoft additions.
Yeah, The sitemap protocal / sitemap autodiscovery is now a standard, yahoo, google, msn and I guess AOL too has adopted it.
So it needs a line in robots.txt to tell it to look for mysite.com/sitemap.xml? Couldn't it just skip a step and look for sitemap.xml itself?
as you know in collaboration of all search engine to utilize robots.txt for auto discovery of your sitemap, MSN though support this but they are not yet implementing it, maybe end of this year according to them
could somone tell me what is the right syntext for the robot file for msn to have it crawl the site map? Thanks
blgg35, it's the same with sitemap with google. you can use the same syntext with it. when you add Sitemap:http://www.sitename.com/sitemap.xml msn and the other sites will find your sitemap