Why google dont add all my pages

Discussion in 'SEO' started by web@master24, Jul 29, 2009.

  1. #1
    Hi, im have my websites with a x10media mp3 search engine script, others websites like me have 40,000 pages in google, but mine have only 8,000 and have more time online and more visits than others, why dont detect all pages? like www.mywebsite.com/search/xxxx/

    I hope you can help me
     
    web@master24, Jul 29, 2009 IP
  2. ALGWorks

    ALGWorks Active Member

    Messages:
    81
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    76
    #2
    Google doesn't actually use search bars to crawl sites. Programming that into a search algorithm would take too much of their server load for indexing and would essentially be impossible (it would basically mean a search within a search within a search if it were to crawl through a search bar and potentially come across another search bar). For similar reasons they typically don't crawl too deep into sites that have pages listed on pages deep within the site (pages 2-3 clicks deep would be ideal, with the fewer the better). The primary thing you should look at is having a good internal link structure that will allow search engine spiders to crawl your site and index any pages you may have. Of course, without having a look at the site it's a bit difficult to tell exactly what's going on.
     
    ALGWorks, Jul 29, 2009 IP
  3. ALGWorks

    ALGWorks Active Member

    Messages:
    81
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    76
    #3
    Some things you should note about your site:

    As I mentioned above, search engines don't index through your site using search queries. Because of this a lot of the links you have in your site will not be searched and indexed by Google and other search providers as the pages will not be seen as relevant.

    Just for the record, however, for a site working as a search engine itself it's pretty good to have over 8000 indexed pages. Similar sites most likely have additional internal content that is also indexed, that's why their sites appear to have so many more indexed pages than yours. If you're really concerned about indexing every one of your pages you can try developing a sitemap and submitting it to search engines for indexing as well. There are a number of automated programs out there that can do this quickly and easily for you.
     
    ALGWorks, Jul 30, 2009 IP
  4. Jectillplum

    Jectillplum Peon

    Messages:
    587
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #4
    i thinks you should have to built up your sitemap.xml with proper way and put your all sites urls in sitemap.xml then just submit it's in Google Web Master Tools. and be sure that you have the proper On Page Optimizations for your sites so after that it's should be happen that Google can crawl your all sites Pages.
     
    Jectillplum, Jul 30, 2009 IP
  5. web@master24

    web@master24 Active Member

    Messages:
    418
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    90
    #5
    If my web is slow, that can be a reason for google dont index?
     
    web@master24, Jul 30, 2009 IP
  6. ALGWorks

    ALGWorks Active Member

    Messages:
    81
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    76
    #6
    It's not so much speed as it is size. Bear in mind that Google has to crawl through hundreds of millions of pages every second to find the most relevant information for its users. By having too large of a site to crawl through that would take a large amount of Google's resources some pages may not be listed properly. This happens a lot if some pages are buried within your site. Therefore if you're really concerned about it I highly recommend taking Jectillplum and my own suggestions to make a sitemap and submit it to the engines. That would ensure that the engine has your entire site on record and can access it easier as well as make sure all of your pages are listed properly.
     
    ALGWorks, Jul 30, 2009 IP
  7. web@master24

    web@master24 Active Member

    Messages:
    418
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    90
    #7
    how i can do the sitemap, the url of my site is this:

    http://tinyurl.com/nd22rz

    If you see no its very slow in the most of pages, but when a user make a search is when late a long time in finish the search, wich tool is better for make a sitemap of this site.
     
    web@master24, Jul 30, 2009 IP
  8. ALGWorks

    ALGWorks Active Member

    Messages:
    81
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    76
    #8
    Try doing a search for some different creators. Some choices could be:

    XML-sitemaps.com - Can index up to 500 pages for free, but a full mapping costs around $20

    Auditmypc.com -Simple free sitemap generator and exporter


    Automapit.com
    - Again, another free sitemap generator.

    Worst case scenario is you could build your own, though that could take a bit of time give your thousands of pages :cool:
     
    ALGWorks, Jul 30, 2009 IP
  9. web@master24

    web@master24 Active Member

    Messages:
    418
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    90
    #9
    Thanks, i go to try made with automapit and auditmypc
     
    web@master24, Jul 30, 2009 IP