10000s pages crawled daily but number of pages indexed rarely change

Discussion in 'Search Engine Optimization' started by corematter, Jan 17, 2011.

  1. #1
    For the past 2 weeks, google has been crawling an average of 45000 pages a daily but only 11000 are indexed. I do see some of the pages that have been updated show up the same day or the next day on google. Is my site kinda in a sandbox or something? Site is new but the domain is not. Major changes to the site from previous months. BTW Google shows no BL. PR is very low. Thx.
     
    corematter, Jan 17, 2011 IP
  2. indyonline

    indyonline Prominent Member

    Messages:
    4,626
    Likes Received:
    248
    Best Answers:
    2
    Trophy Points:
    335
    #2
    I think their just finding your pages with your sitemap. Indexing will take some time with that many pages.
     
    indyonline, Jan 17, 2011 IP
  3. xInd

    xInd Notable Member

    Messages:
    2,025
    Likes Received:
    41
    Best Answers:
    0
    Trophy Points:
    225
    Digital Goods:
    2
    #3
    Yes, it will take time from my experience when dealing with that many pages. Also, remember they group similar pages together coming from the same domain. They will be indexed faster if you build deep links and ping them.
     
    xInd, Jan 17, 2011 IP
  4. Cav

    Cav Greenhorn

    Messages:
    52
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    16
    #4
    google don't show backlinks anymore (or at least not all of them). if you have duplicate content, your sites might be "ignored" aswell.
     
    Cav, Jan 17, 2011 IP
  5. corematter

    corematter Member

    Messages:
    91
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    43
    #5
    Thanks.. They're not duplicate content. It's sort of like a directory. Listing pages and detail pages. So some pages are the same but have some different content.
     
    corematter, Jan 17, 2011 IP
  6. corematter

    corematter Member

    Messages:
    91
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    43
    #6
    Been out of the SEO field for a couple years due to busy work schedule but refresh me what pinging pages is.
    Thanks.
     
    corematter, Jan 17, 2011 IP
  7. Sate

    Sate Peon

    Messages:
    57
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #7
    corematter, If your site - forum, it will not be fully indexed, since so many pages in its structure are trash.

    Just want to ask how old your domain? If he is young it just takes time.

    And another little tip, make a detailed map of the site and feed it to google.

    ___________________________
    sorry for my english, I'm from Russia
     
    Sate, Jan 17, 2011 IP
  8. corematter

    corematter Member

    Messages:
    91
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    43
    #8
    No it's not a forum. The domain 9 yrs old. Sitemap already submitted..
     
    corematter, Jan 17, 2011 IP
  9. Sate

    Sate Peon

    Messages:
    57
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #9
    Ok, let's go to the back side. How did you know that your site 45,000 pages?
    It is possible that only 10000 pages helpful, and the rest will not be value in itself, so Google does not take them to the index.

    Maybe there are 10000 pages in the normal index, while the rest are in the "snot"?

    In general, if you can skinte link to the website, you can, even in private messages.
     
    Sate, Jan 17, 2011 IP
  10. Sate

    Sate Peon

    Messages:
    57
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #10
    Ok got the link and the site looked. Indeed in the index of 11,700 pages.

    And you wrote about this in Google's technical support?
     
    Sate, Jan 17, 2011 IP
  11. corematter

    corematter Member

    Messages:
    91
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    43
    #11
    No.. I haven't.. Since 2001, I always thought emailing google will get no where. Maybe things changed since then?
     
    corematter, Jan 17, 2011 IP
  12. Sate

    Sate Peon

    Messages:
    57
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #12
    Certainly changed. Try to write in the support and explain the situation, they will either help you or give recommendations that need to be done to fully indexed by Google on your site.
     
    Sate, Jan 17, 2011 IP
  13. ska_kashif

    ska_kashif Active Member

    Messages:
    31
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    91
    #13
    i thing page duplication issue can be..
     
    ska_kashif, Jan 17, 2011 IP
  14. corematter

    corematter Member

    Messages:
    91
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    43
    #14
    Alright. Thanks. Will try in a week to see if things change.
     
    corematter, Jan 17, 2011 IP
  15. corematter

    corematter Member

    Messages:
    91
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    43
    #15
    There not really duplicated pages. Just some pages have the same template but different information for each.
     
    corematter, Jan 17, 2011 IP
  16. Sate

    Sate Peon

    Messages:
    57
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #16
    Good try. If that accomplish your goal based on that answer you google a support for your letter.
     
    Sate, Jan 18, 2011 IP
  17. xInd

    xInd Notable Member

    Messages:
    2,025
    Likes Received:
    41
    Best Answers:
    0
    Trophy Points:
    225
    Digital Goods:
    2
    #17
    Pinging a page/site/link means pushing a notification to all the syndication services and websites to tell them there is new content here. The only one coming to mind for me right now is an old one I'm not sure still works, www.pingoat.com
     
    xInd, Jan 18, 2011 IP
  18. Sate

    Sate Peon

    Messages:
    57
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #18
    By the way yes you can use ping, just I'm from Russia and we do not use such methods, so I forgot to offer.
     
    Sate, Jan 18, 2011 IP