Too Big Sitemap!!! Google submissions fail... What to do???

Discussion in 'Google Sitemaps' started by chandrajit1988, Sep 5, 2010.

  1. #1
    I was using the xml-sitemaps plugin in wordpress. But, recently, the no of pages of the websites increasd and it could handle no more giving all sorts of errors. Even Google fails the submission.
    ..

    What to do>?
     
    chandrajit1988, Sep 5, 2010 IP
  2. ipopbb

    ipopbb Member

    Messages:
    7
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    36
    #2
    You have to split the sitemap into several sitemap files... It's been a long time since I had this problem. I forget what the exact number is but it is a big number like 50,000 entries max per file (it's been years for me so it may have changed since). Google webmaster tools lets you submit as many files as you need but each file needs to be under the max limit.

    Hope this helps!

    Ted
     
    ipopbb, Sep 5, 2010 IP
  3. websitetools

    websitetools Well-Known Member

    Messages:
    1,513
    Likes Received:
    25
    Best Answers:
    4
    Trophy Points:
    170
    #3
    Your plugin ought to split sitemaps by itself. But see if there is a setting and try lower the amount of URLs per sitemap file. There's also a 10mb limit per xml sitemap file.

    What errors are you getting?
     
    websitetools, Sep 6, 2010 IP
  4. chandrajit1988

    chandrajit1988 Well-Known Member

    Messages:
    319
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    130
    Articles:
    1
    #4
    Yes, I've stopped using that plugin and started with sitemap index plugin but that's not as good as Google XML Sitemaps plugin.

    When my site was smal, it made sitemaps and submitted theme with every new post. Google used to index stuffs faster.

    But now, google does'nt even come to me.. :(
     
    chandrajit1988, Sep 6, 2010 IP
  5. chandrajit1988

    chandrajit1988 Well-Known Member

    Messages:
    319
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    130
    Articles:
    1
    #5
    How to make google make my new pages index within a few minutes?

    I've seen its possible. I work for a Newspaper Company and I've seen their pages get index within 5 minutes of posting the news.

    So how is it done???
    Pls help.I'm quite sure that sitemaps are the key to success.
     
    chandrajit1988, Sep 6, 2010 IP
  6. websitetools

    websitetools Well-Known Member

    Messages:
    1,513
    Likes Received:
    25
    Best Answers:
    4
    Trophy Points:
    170
    #6
    You can create google news sitemaps. Here's a news sitemap tutorial for A1SG. (If you want immediate updates to Google you may need a CMS/blog plugin instead. Otherwise you can e.g. schedule website scan each hour)
     
    websitetools, Sep 7, 2010 IP
  7. Keppy

    Keppy Peon

    Messages:
    78
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #7
    Google algo is the one that determine the frequency of indexing, depending on how it find the update frequency of a website.
     
    Keppy, Sep 8, 2010 IP
  8. cubicaaron

    cubicaaron Guest

    Messages:
    104
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #8
    The only way you can get indexed within minutes is regular, good quality posts - with an optimised site that loads quickly.
    Generally newspaper sites get indexed quickly because they update their site multiple times a day - so Google Algorithm recognises it's important to index the content for it's users.

    If you push out multiple crappy blogs, Google will not come to your site - so bear this in mind.

    Please post more specific errors that Google Webmaster Tools is giving you - it would be interesting to see what is happening if the sitemap is <10MB and <50,000 Index count.
     
    cubicaaron, Sep 8, 2010 IP
  9. kenny1703

    kenny1703 Greenhorn

    Messages:
    22
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    11
    #9
    Yes, i think this is the good way. i have used this way before. you may check to split the sitemap into several files..and resubmit them too google.
     
    kenny1703, Sep 8, 2010 IP
  10. AlexiaGold

    AlexiaGold Peon

    Messages:
    26
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #10
    I believe a good limit is about 1 MB per sitemap file, any more than that and you should split it into several files.
     
    AlexiaGold, Sep 8, 2010 IP
  11. Allthebest

    Allthebest Peon

    Messages:
    530
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #11
    Splitting the site map big site map in more then one file is good idea but how it can be broken into more then one different file. how i can create site map for more the 1000 pages.
     
    Allthebest, Sep 8, 2010 IP
  12. dennisb

    dennisb Member

    Messages:
    244
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    35
    #12
    A sitemap should consist maximum 50000 URLs or have a size of 10mb. If it is bigger you should separate it in smaller sitemap for example by category on Google there is enough information how to do this ;)
     
    dennisb, Sep 9, 2010 IP
  13. chandrajit1988

    chandrajit1988 Well-Known Member

    Messages:
    319
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    130
    Articles:
    1
    #13
    Yep, Thanks guys..
    Got everything fixed.

    It's back on tracks now.
    I've reverted back to Google Sitemaps Plugin and dumped the SiteMap Index Plugin.

    I had to make a sitemap of only 20,000 URLs where new posts would be included first. The sitemap was small and it worked.

    I guess by the time the old URLs would have gone out of my Sitemap, Google would have indexed them. :)
     
    chandrajit1988, Sep 12, 2010 IP