1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

how to increase crawl pages in google

Discussion in 'Google' started by rajiwebmaster, Apr 20, 2010.

  1. #1
    i had a website which consits of 20000 urls but but when i check in google indexing it showing only 200 urls how should i increase my crawl page in google i createad xml and html sitemap also and i submitted to google webmaster tool also . is any other solution is there to increase the pages in google please help me in this matter
     
    rajiwebmaster, Apr 20, 2010 IP
  2. jinmin

    jinmin Active Member

    Messages:
    448
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    58
    #2
    Depending on the number of pages you have on your site, Google will take time to completely crawl it all. So don't worry. As long as you have good sitemap file, Google will see it all.
     
    jinmin, Apr 20, 2010 IP
  3. WishBone

    WishBone Peon

    Messages:
    2,566
    Likes Received:
    15
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Did you ensure there are no pages containing very similar in contents and titles? SE will usually ignore them in this scenario, also good linking structure is the key for SE bots to navigate and crawl thoroughly big sites like yours..
     
    WishBone, Apr 20, 2010 IP
  4. wordgeist

    wordgeist Peon

    Messages:
    155
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    I have the same problem in one of my site. I would like for google to index all my site (about 3500 pages)
     
    wordgeist, Apr 20, 2010 IP
  5. wayner

    wayner Peon

    Messages:
    684
    Likes Received:
    69
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Like wishbone says, if the content is very similar, titles, meta's and page content, then Google may only index a single version of the pages that it considers similar, though for this to be the case the pages would have to be almost identical with very few changes, particularly in the main content.

    If the content on all pages is all unique then it something else and the best thing to do is sign up with Google webmasters central (http://www.google.com/webmasters/) and upload a sitemap for your entire site, you can generate a sitemap to upload here: http://www.xml-sitemaps.com/

    Good luck

    Phil
     
    wayner, Apr 20, 2010 IP
  6. bogs

    bogs Active Member

    Messages:
    2,142
    Likes Received:
    16
    Best Answers:
    0
    Trophy Points:
    80
    #6
    site: command is not really accurate.. you can try building more links to your inner pages.. it helps to index your other pages.. by the way it also depends on your site link structure.. make sure it is bot friendly..
     
    bogs, Apr 20, 2010 IP
  7. soulravager

    soulravager Active Member

    Messages:
    270
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    80
    #7
    Also try pinging the URLS that are not yet indexed ! Try also to do a little bit of blogcommenting on HIGH PR Do-follow blogs but don't go overboard.
     
    soulravager, Apr 21, 2010 IP
  8. berg101

    berg101 Peon

    Messages:
    327
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #8
    Just Make sure that you follow these..\

    - Title of each page is different.
    - you are updating each page frequently.
    - You have given Google enough time to crawl.
     
    berg101, Apr 21, 2010 IP
  9. croxxknight

    croxxknight Active Member

    Messages:
    99
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    93
    #9
    Link your each article accordingly.. The very first article linking to the second page then the second page linking back to the third page and so on.. This is easier to do if you apply it earlier..
     
    croxxknight, Apr 21, 2010 IP
  10. bruce_robart

    bruce_robart Member

    Messages:
    547
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    30
    #10
    try to do more RSS feed submission...
     
    bruce_robart, Apr 21, 2010 IP
  11. Employwise

    Employwise Peon

    Messages:
    15
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #11
    -Make RSS feed of your site
    - Get quality backlinks for your site.

    HRIS | HRMS
     
    Employwise, Apr 21, 2010 IP
  12. China_girl

    China_girl Well-Known Member

    Messages:
    4,096
    Likes Received:
    72
    Best Answers:
    0
    Trophy Points:
    195
    #12
    20,000 urls, would you like to share your site with us. I would really want to have a look of the site which has 20k urls and only 200 are indexed in google !!!
     
    China_girl, Apr 21, 2010 IP
  13. wildogre

    wildogre Well-Known Member

    Messages:
    1,018
    Likes Received:
    8
    Best Answers:
    0
    Trophy Points:
    128
    #13
    Make your url search engine friendly. Also submit sitemap it'll increase google crawl pages.
     
    wildogre, Apr 21, 2010 IP
  14. y2k2

    y2k2 Guest

    Messages:
    212
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #14
    Depending how much page you have
     
    y2k2, Apr 21, 2010 IP
  15. stefffff

    stefffff Active Member

    Messages:
    194
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    53
    #15
    my site has more then 50.001 links and google says he can't accept such a big sitemap... he suggests i should split that in 2 pieces... how ?
     
    stefffff, Apr 21, 2010 IP
  16. lulabie

    lulabie Member

    Messages:
    218
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    26
    #16
    Make a lot of your page..
     
    lulabie, Apr 21, 2010 IP
  17. Sxperm

    Sxperm Notable Member

    Messages:
    4,386
    Likes Received:
    142
    Best Answers:
    0
    Trophy Points:
    225
    #17
    You may consider these options :)

    1. Link Building - You should done it for both homepage and inner page (aka. deep link building).

    2. Internal Linking - Check out to see if you are currently optimizing internal linking structure enough.

    3. Social Bookmark - This could help your inner pages for fast index but a short period only. Overdoing it could lead you website being banned from social bookmark permanently, so use it cautions.
     
    Sxperm, Apr 21, 2010 IP
  18. mye-corporation

    mye-corporation Peon

    Messages:
    112
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #18
    I agree with all of this, also take into consideration the amount of outside links pointing to your site, this increases the importance of it to google and will crawl it more frequently.
     
    mye-corporation, Apr 21, 2010 IP
  19. itsupportservice

    itsupportservice Peon

    Messages:
    93
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #19
    You should change the content of your site with some specific interval & you should also change meta & other tags accordingly.. So from that google will crawl you site more frequently..!!
     
    itsupportservice, Apr 21, 2010 IP
  20. makobex

    makobex Active Member

    Messages:
    98
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    91
    #20
    i have the same trouble can we have the exact solution pls
     
    makobex, Apr 21, 2010 IP