hi, I have 50,000 urls that need to be visited by a bot/browser before they can be compiled into a sitemap. Would there be a program like an autoclicker that clicks the 50,000 urls in a list 1 by 1, say, every 20 seconds?
Any reason you don't use a sitemap generator program like e.g. A1 Sitemap Generator? Under all circumstances, using such crawler/sitemapper software will make requests to all URLs in your website. (And then why not generate the sitemap using those tools as well?)