Hi and happy new year to everyone! MSN has managed to freak me out big time here! I'm devloping a new website with the index displaying a simple "in devlopment message" with no links into the "site". It's a Zencart site with the working taking place at domainname/store there are no links to it from the index etc but MSN is displaying domainname/store/xyz.html How the hell is this happening? I guess I shouldn't really be complaining, in fact I guess I'm quite pleased but I just can't get my head around how MSN knows it is there, unless they are spying on the Google toolbar, lol Any ideas anyone? Happy new year!
do you have msn toolbar installed on you computer? maybe it could be spyware in IE that sends info to MSN ???
Toolbar would definately do that...I've also heard that SE look through newly registered domains and spider them that way as well
I only have Google toolbar and, thankfully, the domain has been listed in Google, but I can't see how that can accout for MSN. The only thing I can think of is that it guesses - but that has got to be a stab in the dark! Thanks for your replies.
Wow, having your website indexed by MSN is a bad thing Don't worry about it, it's too late to remove it anyway, unless you want to send them an E-Mail asking them to remove it...which I would suggest you don't..
MSN and Yahoo use to spider closed or restricted sites with Google Adsense because the MediaPartners-bot goes to crawl them to serve the ads but indexing them as well. Another fact is dynamic sites, if your site was already indexed the robots goes back looking for the old dynamic content and amazingly the servers return a 200 code even if those pages are gone forever.