Huge Site Map..... How to create???

Hi All,

My site is having approx 40K pages in it.

Can anyone tell me how to create Site Map for such a huge site??

I don't want to cross Google webmaster limitations.

 

Hey No one having any idea????

 

Whats the site?

 

You can put up to 50,000 URLs in a single sitemap, as long as the uncompressed size is under 10 megs.

Other wise, you can make a handful of sitemaps (10,000 URLs each, for example) and submit those.

 

try here, but above 500 pages it`s paid service

http://www.xml-sitemaps.com/

 

I want to make HTML not a XML sitemap

 

Try this - http://home.snafu.de/tilman/xenulink.html

I remember it spiders all the URLs on your site, you may be able to use that in some way.

Any reason why you don't want to create a XML sitemap though?

 

hey i will suggest you to add only main pages in the sitemap.

Else go for many html sitemap pages

 

I'll surely go for xml sitemap but the confusion is for html sitemap only.

M confused how many links should i include in a page??? and how many site maps in a site???

 

That's probably why an auto generated XMP sitmap is a better option.

No more than 100 links per page though.

Organise it like this,

Sitemap Index
---------------> Category Index
----------------------------------> Links Pages

 

you can use an xml sitemap index to point to several xml-sitemaps: google.com/webmasters/tools/docs/en/protocol.html#sitemapFileRequirements (sorry, don't have permissions yet to post urls)

for html sitemaps use > 100 links per page, dice into categories. Remember to noindex.follow the robots meta-tag (html sitemap shouldn't rank, usually that is)

 

Probalby because he may want to create a site map that people can use.

Ridhdhi, make sure your sitemap PAGES have no more than 100 links in them. If you need to, create a category index for your main sitemap page (treat it like a landing page - I mean section/category index - I really need to stop letting this SEO jargon get to me) with each top-level category having its own link to the specific category it links to which will in turn contain the links for the sub-categories and the pages contained within it.

That's just one way to do it, but I'd need to see the site in question in order to be able to tell you how to structure your site map for your Web site's human visitors while stlil complying with the search engines' guidelines (a background in information architecture really comes in handy at times like this).

 

That's the point - people aren't supposed to use sitemaps. The site structure, navigation and breadcrumbs should be easy enough for people to get to where they want to go without having to resort to a sitemap. Once a sitemap is aimed at visitors rather than search engines then it stops being a sitemap and becomes navigation.

If visitors are having to resort to the sitemap then you'll probably need to revisit your navigation and make sure it's as intuitive as possible.

 

The thing is though, not everyone uses the menu or search form to navigate through a Web site. Some are more comfortable using a site map to find their way around, especially when they're looking for multiple things at once - something a search engine cannot do very well.

They do have their uses.

 

So what are the auto sitemap generator programs? I need one of these too. Are they recommended? Or do you have to update your sitemap everytime you add a page to the site? what if pages are added dynamically?

 

if pages are added dynamically, the sitemap must be updated automatically. In most cms systems, that shouldn't be too hard

 

xml.sitemaps allows you to download the sitemap in different formats one being html so you can still do it there however as has been said over 500 pages i think you have to pay, could get expensive.

 

Thanks every one for your suggestions...

Is there anything like rolling sitemap????

 

i use this xml sitemaps free online tool and as already said it has a option to download sitemap if different formats. So i think this will be of more help. And i would suggest you to put link of main categories in sitemap rather than placing all deep categories in the same html..