Doe it go by MSNbot? or something else? I cant seem to find any entry of them even visiting... would it come up under something else?
you sure your not seeing the bot? check your logs for it again should say MSNBOT+ or something like that some crawlers disquise themselves google is known for this childish tactic but I don't know if Billybot has I know I am frequented by bitorical.org or something like that no traffic but the bugger burns my bandwidth up.
i have a lot of "unknowns" in my bot logs... googlebot doesn't show up too much either but according to sitemap data, they visit every 3-4 days..
Unknown means mapping tools operated by users and bots belong to minor search engines. Major bots are: Googlebot MSNBot Yahoobot AskJeeves and Alexa They respect robot.txt file. Server count hits on this file. If you do not have a robot.txt file, most probably major search engines will ignore your site. However, other bots will still map your site.
as I mentioned in another post I beileve the bot has temporarly stopped crawling sites because msn is sifting through 100 million pages and rolling out a new algorithm.
Any idea's on what this new algorithm is likely to be or when it's due to go live? MSN has been spidering my sites a little less lately.
msn is actually working on a new stuff which they did not say what it was . this is the problem that we are facing right now