Wordpress Themes - Apartment Budapest - Property in Germany - Gavin Newsom - Cheap Cameras

PDA

View Full Version : MSN spidering strangely...


THT
Jun 14th 2004, 1:13 pm
if you take a look at the attached picture, you will see that msn seems to be spidering strangely.
Some pages get spidered individually and some pages seem to link through.

eg, some msn sessions spider just one page and others spider several in a session


any idea why?

EDIT : Atachments dont work for me - http://www.the-html-tutorial.com/Images/stats.bmp

THT
Jun 16th 2004, 3:28 am
no one knows?

SEbasic
Jun 16th 2004, 5:15 am
I'm not too sure what the image means... sorry...

Could you explain a little more fully...

But, If you are saying that MSN doesn't deep crawl you site everytime it visits, that really isn't too much of a surprise...

I get deep crawled once a day or so by google (on a fairly boring site) but it visits at least 15/20 times a day (not a very big site)...

But if that wasn't what you were asking about, please explain and perhaps I can help...

Cheers

THT
Jun 16th 2004, 6:07 am
i just wondered why sometimes msn crawls more than one page in a session and sometimes only crawls one.

These stats are for one day only, but this happens every day

tbh, i was concerned that some of my links where stopping the msn bot spidering correctly