Trouble Creating Sitemap

Discussion in 'Google Sitemaps' started by Jin, Jun 22, 2008.

  1. #1
    I have a huge site and its been really tough to create a sitemap for it, i have tried almost every thing AuditmyPc sitemap hangs at about 9k urls, Gsitecrawler Hangs about 6k urls, Vigos hangs at 15k urls, PHPSitemapNG doesnt have proper filters i assume as its scanning pages which i had excluded in scan, Google-Sitemap aint working for me either as my site is dynamic and database driven. I am really lost and need some help regarding the sitemap.
     
    Jin, Jun 22, 2008 IP
  2. m3rv

    m3rv Peon

    Messages:
    9
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Did U try increase amount of memory available for java in AuditmyPC? If not, try this - they have faq about this in a system menu.

    If doesn't work try stronger PC with faster CPU and more memory - I've had the same problem, I solved this with new, stronger PC.
     
    m3rv, Jun 22, 2008 IP
  3. Jin

    Jin Well-Known Member

    Messages:
    488
    Likes Received:
    14
    Best Answers:
    0
    Trophy Points:
    108
    #3
    Yes, i did that as well. Before increasing memory it hanged on 5k urls then increased memory and it hanged on 9k urls.
     
    Jin, Jun 22, 2008 IP
  4. RootShell

    RootShell Well-Known Member

    Messages:
    855
    Likes Received:
    18
    Best Answers:
    0
    Trophy Points:
    130
    Digital Goods:
    1
    #4
    RootShell, Jun 22, 2008 IP
  5. suxk0s

    suxk0s Peon

    Messages:
    28
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #5
    using RootShell's idea and working... use software if you have trouble in cr8ing one
     
    suxk0s, Jun 22, 2008 IP
  6. RootShell

    RootShell Well-Known Member

    Messages:
    855
    Likes Received:
    18
    Best Answers:
    0
    Trophy Points:
    130
    Digital Goods:
    1
    #6
    Thx suxk0s
     
    RootShell, Jun 23, 2008 IP
  7. kmap

    kmap Well-Known Member

    Messages:
    2,215
    Likes Received:
    29
    Best Answers:
    2
    Trophy Points:
    135
    #7
    how many total pages you have on site

    I can generate you a sitemap with upto 100000 links in 4-5 days

    PM me for further discussion

    Regards

    Alex
     
    kmap, Jun 23, 2008 IP
  8. websitetools

    websitetools Well-Known Member

    Messages:
    1,513
    Likes Received:
    25
    Best Answers:
    4
    Trophy Points:
    170
    #8
    You can also try A1 Sitemap Generator. If you have problems, just follow the configuration suggestions outlined here (in default mode, A1SG picks up and stores lots of extra information that isn't needed for sitemaps, but nice to have when e.g. analysing your website for errors)
     
    websitetools, Jun 24, 2008 IP
  9. NZHeyzoos

    NZHeyzoos Peon

    Messages:
    7
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #9
    Google sitemap should work if you point it at your access logs. This is the way I do it. Can you post the link to your site and I will have a look.
     
    NZHeyzoos, Jun 25, 2008 IP
  10. sultanofseo

    sultanofseo Notable Member

    Messages:
    9,930
    Likes Received:
    405
    Best Answers:
    0
    Trophy Points:
    265
    #10
    just google for html or xml sitemap and you will find some online tools to generate sitemaps
     
    sultanofseo, Jun 25, 2008 IP
  11. Jin

    Jin Well-Known Member

    Messages:
    488
    Likes Received:
    14
    Best Answers:
    0
    Trophy Points:
    108
    #11
    I have done that as well but didn't go through :(
     
    Jin, Jun 25, 2008 IP
  12. Jin

    Jin Well-Known Member

    Messages:
    488
    Likes Received:
    14
    Best Answers:
    0
    Trophy Points:
    108
    #12
    mate that xml-sitemap.com thing just scans 500 urls and i am not sure even if i buy that tool it would scan all urls like others.
     
    Jin, Jun 25, 2008 IP
  13. Jin

    Jin Well-Known Member

    Messages:
    488
    Likes Received:
    14
    Best Answers:
    0
    Trophy Points:
    108
    #13
    I had installed a1 sitemap few months back but never used it and eventually the trial version expired after 30 days so i cant even test it now. I have now hired a coder to write some php code which could pull all urls from my mysql database with in few minutes or less, i hope it shall work. Its been really tough :D
     
    Jin, Jun 25, 2008 IP