Hi Why it happens? I mean if you check in Google how many pages is crawled for a web site, it gives you 100 while if you check this in Yahoo it will give you more than 100 in most of the case even same for MSN. Can anybody explain it why it happens? Thank You
Google has a different set of rules, how deep it will crawl for example or what pages are worth indexing. Also what they say they have and what they actually have are two different things. FFMG
Yahoo treats www.yourdomain.com/list.php?sort=alphabetically as a separate document compared to www.yourdomain.com/list.php?sort=byprice albeit the exact same data. Google tends to leave one. That's in my experience.