1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Huge Site Map..... How to create???

Discussion in 'Search Engine Optimization' started by Ridhdhi, Jun 13, 2008.

  1. #1
    Hi All,

    My site is having approx 40K pages in it.

    Can anyone tell me how to create Site Map for such a huge site??:eek:

    I don't want to cross Google webmaster limitations.
    SEMrush
     
    Ridhdhi, Jun 13, 2008 IP
    SEMrush
  2. Ridhdhi

    Ridhdhi Banned

    Messages:
    184
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Hey No one having any idea???? :(
     
    Ridhdhi, Jun 13, 2008 IP
  3. dddougal

    dddougal Well-Known Member

    Messages:
    676
    Likes Received:
    19
    Best Answers:
    0
    Trophy Points:
    108
    #3
    Whats the site?
     
    dddougal, Jun 13, 2008 IP
  4. mickmel

    mickmel Peon

    Messages:
    385
    Likes Received:
    19
    Best Answers:
    0
    Trophy Points:
    0
    #4
    You can put up to 50,000 URLs in a single sitemap, as long as the uncompressed size is under 10 megs.

    Other wise, you can make a handful of sitemaps (10,000 URLs each, for example) and submit those.
     
    mickmel, Jun 13, 2008 IP
  5. gina.alessia

    gina.alessia Well-Known Member

    Messages:
    449
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    110
    #5
    gina.alessia, Jun 13, 2008 IP
  6. Ridhdhi

    Ridhdhi Banned

    Messages:
    184
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #6

    I want to make HTML not a XML sitemap
     
    Ridhdhi, Jun 13, 2008 IP
  7. MattUK

    MattUK Notable Member

    Messages:
    6,950
    Likes Received:
    377
    Best Answers:
    0
    Trophy Points:
    275
    #7
    Try this - http://home.snafu.de/tilman/xenulink.html

    I remember it spiders all the URLs on your site, you may be able to use that in some way.

    Any reason why you don't want to create a XML sitemap though?
     
    MattUK, Jun 13, 2008 IP
  8. andrewaff

    andrewaff Active Member

    Messages:
    265
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    75
    #8
    hey i will suggest you to add only main pages in the sitemap.

    Else go for many html sitemap pages
     
    andrewaff, Jun 13, 2008 IP
  9. Ridhdhi

    Ridhdhi Banned

    Messages:
    184
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #9
    I'll surely go for xml sitemap but the confusion is for html sitemap only.

    M confused how many links should i include in a page??? and how many site maps in a site???:confused:

     
    Ridhdhi, Jun 13, 2008 IP
  10. MattUK

    MattUK Notable Member

    Messages:
    6,950
    Likes Received:
    377
    Best Answers:
    0
    Trophy Points:
    275
    #10
    That's probably why an auto generated XMP sitmap is a better option.

    No more than 100 links per page though.

    Organise it like this,

    Sitemap Index
    ---------------> Category Index
    ----------------------------------> Links Pages
     
    MattUK, Jun 13, 2008 IP
  11. monchito

    monchito Active Member

    Messages:
    10
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    86
    #11
    you can use an xml sitemap index to point to several xml-sitemaps: google.com/webmasters/tools/docs/en/protocol.html#sitemapFileRequirements (sorry, don't have permissions yet to post urls)

    for html sitemaps use > 100 links per page, dice into categories. Remember to noindex.follow the robots meta-tag (html sitemap shouldn't rank, usually that is)
     
    monchito, Jun 13, 2008 IP
  12. Dan Schulz

    Dan Schulz Peon

    Messages:
    6,032
    Likes Received:
    434
    Best Answers:
    0
    Trophy Points:
    0
    #12
    Probalby because he may want to create a site map that people can use.

    Ridhdhi, make sure your sitemap PAGES have no more than 100 links in them. If you need to, create a category index for your main sitemap page (treat it like a landing page - I mean section/category index - I really need to stop letting this SEO jargon get to me) with each top-level category having its own link to the specific category it links to which will in turn contain the links for the sub-categories and the pages contained within it.

    That's just one way to do it, but I'd need to see the site in question in order to be able to tell you how to structure your site map for your Web site's human visitors while stlil complying with the search engines' guidelines (a background in information architecture really comes in handy at times like this).
     
    Dan Schulz, Jun 13, 2008 IP
  13. MattUK

    MattUK Notable Member

    Messages:
    6,950
    Likes Received:
    377
    Best Answers:
    0
    Trophy Points:
    275
    #13
    That's the point - people aren't supposed to use sitemaps. The site structure, navigation and breadcrumbs should be easy enough for people to get to where they want to go without having to resort to a sitemap. Once a sitemap is aimed at visitors rather than search engines then it stops being a sitemap and becomes navigation.

    If visitors are having to resort to the sitemap then you'll probably need to revisit your navigation and make sure it's as intuitive as possible.
     
    MattUK, Jun 14, 2008 IP
  14. Dan Schulz

    Dan Schulz Peon

    Messages:
    6,032
    Likes Received:
    434
    Best Answers:
    0
    Trophy Points:
    0
    #14
    The thing is though, not everyone uses the menu or search form to navigate through a Web site. Some are more comfortable using a site map to find their way around, especially when they're looking for multiple things at once - something a search engine cannot do very well.

    They do have their uses. :)
     
    Dan Schulz, Jun 14, 2008 IP
  15. MtCowboy4Life

    MtCowboy4Life Peon

    Messages:
    242
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #15
    So what are the auto sitemap generator programs? I need one of these too. Are they recommended? Or do you have to update your sitemap everytime you add a page to the site? what if pages are added dynamically?
     
    MtCowboy4Life, Jun 14, 2008 IP
  16. monchito

    monchito Active Member

    Messages:
    10
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    86
    #16
    if pages are added dynamically, the sitemap must be updated automatically. In most cms systems, that shouldn't be too hard
     
    monchito, Jun 15, 2008 IP
  17. willyboy104

    willyboy104 Active Member

    Messages:
    2,852
    Likes Received:
    80
    Best Answers:
    0
    Trophy Points:
    90
    #17
    xml.sitemaps allows you to download the sitemap in different formats one being html so you can still do it there however as has been said over 500 pages i think you have to pay, could get expensive.
     
    willyboy104, Jun 15, 2008 IP
  18. Ridhdhi

    Ridhdhi Banned

    Messages:
    184
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #18
    Thanks every one for your suggestions...:)

    Is there anything like rolling sitemap????
     
    Ridhdhi, Jun 15, 2008 IP
  19. seo_kate

    seo_kate Peon

    Messages:
    362
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #19
    i use this xml sitemaps free online tool and as already said it has a option to download sitemap if different formats. So i think this will be of more help. And i would suggest you to put link of main categories in sitemap rather than placing all deep categories in the same html..
     
    seo_kate, Jun 16, 2008 IP