I was using a tool named "Vigos Gsitemap" but it is crashing after 6000 pages saying "memory problem" etc What tool do you use to generate sitemaps for very large site? I am questioning here about a flat EXE tool (a remote generation method) Thanks
i dont think making a map of that many pages is so great. is this real content or some page generation software you used to make it. free sitempa generator in G to find such a tool
I am having the same issue. I ended up listing the major urls? As a result my SERP traffic from Google dropped to some extent.
I am busy in testing the SOFTplus GSiteCrawler .... it seems to work so far but it is much much more slower ..... already 1 night and still 5349 url to process
Try audit my pc. The link is http://www.auditmypc.com/free-sitemap-generator.asp and you have to click on the image that says webmaster tool.
6000 pages is a fairly low amount of pages compared to some websites I know I suggest you try A1 Sitemap Generator
I tried a bunch of things and ran into all sorts of problems. Some didn't allow enough pages, some crashed, and some seemed too slow. In the end I paid for this: http://www.xml-sitemaps.com/standalone-google-sitemap-generator.html Overall I am pleased, but it is not without problems. It takes about a day to complete, and can add a bit to the CPU load, so I only run it every two weeks or so. I have only had it a few months, so it has been updated maybe three or four times to date. On one site, the site map has submitted 148,848 pages to Google. As a result, the Google "site:" statistics have climbed from 18,000 to 49,000 - and are still rising.
The online one? Or the standalone? The online one convinced me that it was finally the script for me and I downloaded it. While it definitely works, it could be better. Maybe I am just ignorant, but making a sitemap doesn't seem like it should take so long and be so processor intensive.
Glad to see it isn't just me... although it would be nice if it worked well for all. Anyone else also have issues of it being interrupted, despite checking the box to keep it from happening? I would say I wind up restarting each sitemap generation at least twice since it seems to stop some time after I go to bed...
there is some tools that you can prevent some page from being craled such as log in pages I do not remember the name right now
Might be easier to just write your own script. My site has 25,000 pages+ and growing. I spent a couple of hours trying to find a free xml generator with no luck. Build my own in an hour. Done.