i'm trying to make a sitemap for my site(http://www.angervent.com) but it's kinda weird. I have that as my main page, which redirects to the 2nd main page after showing a graphic. The weird part is that I have a whole bunch of other parts of the site that are seperate(http://www.angervent.com/acne or http://www.angervent.com/cars). i cant seem to get a sitemap that will include all of the pages. On the entire site i have over 20 thousand pages which are mostly articles. I have no idea how to do this, and any help would be greatly appreciated. Many thanks
Also what may be the problem (purely guessing) is if your website webserver make connection and read timeouts when under heavy work. Worth trying if you can get more pages by throttling crawling down to less pages / second.