1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

My service has over 500,000 pages. Can't get a good sitemap. Help!

Discussion in 'Google Sitemaps' started by qwikad.com, Jan 23, 2012.

  1. #1
    We (me and my wife) started a free classifieds service: www.qwikad.com and while it's still growing we have already encountered a problem. We can't get a full sitemap. After about 20,000 pages sitemap generator freezes. Is there something we are doing wrong? Are there good sitemap generators out there? Any help will be appreciated.
    SEMrush
     
    qwikad.com, Jan 23, 2012 IP
    SEMrush
  2. photalian

    photalian Peon

    Messages:
    15
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    you might need something coded by a developer to work server side.
     
    photalian, Jan 23, 2012 IP
  3. cPAce

    cPAce Peon

    Messages:
    445
    Likes Received:
    8
    Best Answers:
    0
    Trophy Points:
    0
    #3
    I would signup for Attracta.com and the site map tool they provider should be able to help. I also suggest recoding that site so new pages are just mod rewrites which would lower the pages big time and the only thing that would show up is the cities page and the state page.
     
    cPAce, Jan 23, 2012 IP
  4. qwikad.com

    qwikad.com Illustrious Member Affiliate Manager

    Messages:
    5,925
    Likes Received:
    1,096
    Best Answers:
    22
    Trophy Points:
    400
    #4
    Do you mean I can somehow get a sitemap from the server? If it can be done, I could try to call the web hosting provider to find out if they can help.
     
    qwikad.com, Jan 28, 2012 IP
  5. webrickco

    webrickco Active Member

    Messages:
    268
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    60
    #5
    is this so important to put all of your 500000 pages on the sitemap? If you want to do so, keep in mind that your xml sitemap will have to be divided in pieces of 50000 urls with no more than 10mb each.
     
    webrickco, Jan 29, 2012 IP
  6. qwikad.com

    qwikad.com Illustrious Member Affiliate Manager

    Messages:
    5,925
    Likes Received:
    1,096
    Best Answers:
    22
    Trophy Points:
    400
    #6
    So WHAT can be done? My classifieds keep growing, will Google still crawl it whether I submit a full sitemap or not?
     
    qwikad.com, Feb 1, 2012 IP
  7. thsadmin

    thsadmin Notable Member

    Messages:
    4,889
    Likes Received:
    133
    Best Answers:
    1
    Trophy Points:
    240
    Digital Goods:
    2
    #7
    I had a look at your site and a lot of it is empty, it's well and good to have a lot of pages - but Google suggests that you trickle pages into your site - instead of rushing them in at once as it looks fake and like junk - looks automated. Google wont even consider adding your pages if there's no content on them...

    http://qwikad.com/-54/posts/1-community/1-activities/ - "there are no ads in this category yet"
    http://qwikad.com/269/posts/4-dating/ - "there are no ads in this category yet"
    http://qwikad.com/269/posts/5-for-sale/ - "there are no ads in this category yet"

    etc. etc.

    Then pages like this... there's to many links and not enough content - normal text.

    http://qwikad.com/269/posts/3-jobs/

    You will have major issues - unless you fill in all of the blanks and get some content into the site, all of the pages with - "there are no ads in this category yet" will be considered junk and duplicate pages because they all look and contain the same content.
     
    thsadmin, Feb 1, 2012 IP
  8. qwikad.com

    qwikad.com Illustrious Member Affiliate Manager

    Messages:
    5,925
    Likes Received:
    1,096
    Best Answers:
    22
    Trophy Points:
    400
    #8
    Thank you for the info, I know I still have quite a few empty pages there, but still it is growing pretty fast. The content of any classifieds is in the ads that come from the visitors.

    But you know what? I think I am beginning to realize something. I don't think it really matters if any of the pages (except the index page) are indexed by google in my case. Most visitors/posters I have now didn't find me through google. And once it gets popular google will rank it higher and higher just because.
     
    qwikad.com, Feb 1, 2012 IP
  9. thsadmin

    thsadmin Notable Member

    Messages:
    4,889
    Likes Received:
    133
    Best Answers:
    1
    Trophy Points:
    240
    Digital Goods:
    2
    #9
    While the attitude is good to let things occur naturally, the things mentioned above still hold true, you still need to be indexed to get "higher and higher" in search rankings, you need to deliver traffic to those who are in your directory - that's your service to them... you still need to target some key word search terms... so even if you cover some basics - like get higher rankings for some of your categories that are popular search terms... Basically you have to be indexed to be an effective directory for several reasons; A) To benefit the listings with a link back to their site (it doesn't count as a link if your page isn't indexed), B) To deliver them traffic... if you're not getting much traffic then you can't deliver much either.
     
    thsadmin, Feb 1, 2012 IP
  10. searchforoffer

    searchforoffer Peon

    Messages:
    17
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #10
    you should try
    auditmypc.com/

    this is a good site
     
    searchforoffer, Feb 2, 2012 IP
  11. biggerlol

    biggerlol Peon

    Messages:
    74
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #11
    You can create sitemap with php and mysql, don't need any sitemaps generator
     
    biggerlol, Jul 23, 2012 IP
  12. CafaMagician80

    CafaMagician80 Active Member

    Messages:
    98
    Likes Received:
    18
    Best Answers:
    0
    Trophy Points:
    68
    #12
    And nobody here knew enough about sitemaps to tell the guy there is a 50.000 URL limit for a sitemap??

    sitemaps.org/protocol.html

    For 500.000 pages, you'd need to create a sitemap.xml which would serve as an index, listing for example sitemap1.xml, sitemap2.xml...that's the only way to create a sitemap with that many pages. BTW, as biggerlol said, you should create a sitemap with PHP, preferably as a cron job so it updates itself automatically.
     
    CafaMagician80, Jul 26, 2012 IP