I was wondering, Does it make a search engines life more difficult to crawl a site that has a url such as: http://mydomain.com/category/aircleaningproducts.html with 3 levels? What is the most I can have before the spiders will not crawl it? Thanks, Donald
Mmmm I guess it really varies site to site and based on content and incoming links (to that particular page), I've had success with similar before. I think characters like ? marks have more issues, I find my sites with ? marks in them are usually thrown into the "Similar Pages from This Site" results (in Google and Search Engines).
Regarding the URL above, it is regarded as search engine friendly, even though its going 3 levels deep, it still seems fine, if your whole site is linked nicely and not too many broken links you should be fine. As thsadmin points out, its when you have sites with lots of pages showing ? and other stuff in the url that their not so ideal. Sessions ID's i think their called, or is that something else?