need unlimited sitemap generator

Discussion in 'Google Sitemaps' started by aliraza168, Jan 21, 2014.

0
  1. #1
    i need a unlimited sitemap generator which should add unlimited pages in sitemap. i have a movie site with over 15k movies. but it currently have only 5k movies in sitemap file. so i need a sitemap generator which should be fast, and whenever i add a movie in my site it should be automatically added in sitemap file. it should also exclude some links that i dont want in my sitemap file. i have php script installed, so i need a sitemap generator in php with cronjob function.
     
    aliraza168, Jan 21, 2014 IP
  2. sarahk

    sarahk iTamer Staff

    Messages:
    28,808
    Likes Received:
    4,534
    Best Answers:
    123
    Trophy Points:
    665
    #2
    What cms are you using?
    Sitemaps aren't that complicated, you could write your own in a couple of hours if you can't find one for your cms
     
    sarahk, Jan 21, 2014 IP
  3. Nigel Lew

    Nigel Lew Notable Member

    Messages:
    4,642
    Likes Received:
    406
    Best Answers:
    21
    Trophy Points:
    295
    #3
    Nigel Lew, Jan 21, 2014 IP
  4. sarahk

    sarahk iTamer Staff

    Messages:
    28,808
    Likes Received:
    4,534
    Best Answers:
    123
    Trophy Points:
    665
    #4
    Xenu does it too, but it's more efficient to have it running on the site and querying the database.
     
    sarahk, Jan 21, 2014 IP
  5. Mrh mamun

    Mrh mamun Member

    Messages:
    67
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    40
    #5
    try xml-sitemap(dot) com premium ....
     
    Mrh mamun, Jan 21, 2014 IP
  6. swasa

    swasa Member

    Messages:
    306
    Likes Received:
    4
    Best Answers:
    1
    Trophy Points:
    43
    #6
    Generate the sitemap for unlimited pages, by using xml-sitemaps. http://www.xml-sitemaps.com/standalone-google-sitemap-generator.html
     
    swasa, Jan 21, 2014 IP
  7. aliraza168

    aliraza168 Member

    Messages:
    80
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    38
    Digital Goods:
    2
    #7
    it has limit of 5000 pages.
     
    aliraza168, Jan 21, 2014 IP
  8. aliraza168

    aliraza168 Member

    Messages:
    80
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    38
    Digital Goods:
    2
    #8
    i am not a coder.
     
    aliraza168, Jan 21, 2014 IP
  9. apt-get update

    apt-get update Well-Known Member

    Messages:
    53
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    143
    Digital Goods:
    1
    #9
    Have you try hxxp://enarion.net/tools/phpsitemapng/
    I've made 14k indexed page using that sitemap.
     
    apt-get update, Jan 22, 2014 IP
  10. websitetools

    websitetools Well-Known Member

    Messages:
    1,513
    Likes Received:
    25
    Best Answers:
    4
    Trophy Points:
    170
    #10
    Maybe A1 Sitemap Generator

    Pros:
    You can cron/automate job.
    You can create video sitemaps with it - but check first it works the way you like with the video platform you use.
    You can exclude areas from website-crawl and sitemap-output.

    Cons:
    You will need to re-run the crawl of your website to find new videos and have them added.
    You will need to ensure your server/site speed can handle the crawl load - especially if you configure A1SG to use many threads and connections. (I mention this because you wrote you needed it to be fast.)

    Alternatively - have someone code you a script that communicates with your database (?) - it might be the only solution you will be 100% happy with based on your specifications.
     
    websitetools, Jan 23, 2014 IP
  11. aliraza168

    aliraza168 Member

    Messages:
    80
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    38
    Digital Goods:
    2
    #11
    my site is on shared hosting and it have about 10000 pages which i want to index. is there anyway that i can index all the pages faster and it doesn't overload the server.
     
    aliraza168, Jan 23, 2014 IP
  12. mrgilb

    mrgilb Active Member

    Messages:
    326
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    75
    #12
    If its a wordpress site make sure to have pages cached as much as possible with a plugin.
     
    mrgilb, Jan 23, 2014 IP
  13. aliraza168

    aliraza168 Member

    Messages:
    80
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    38
    Digital Goods:
    2
    #13
    its not a wordpress site.
     
    aliraza168, Jan 24, 2014 IP
  14. Lanie2013

    Lanie2013 Member

    Messages:
    23
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    31
    #14
    If your hosting doesn't provide cronjobs, you may try easycron.com as a trigger.
     
    Lanie2013, Jan 26, 2014 IP
  15. websitetools

    websitetools Well-Known Member

    Messages:
    1,513
    Likes Received:
    25
    Best Answers:
    4
    Trophy Points:
    170
    #15
    Maybe if you set the crawl to be standard speed, but automate it to scan during the night?
     
    websitetools, Jan 28, 2014 IP