i had a website which consits of 20000 urls but but when i check in google indexing it showing only 200 urls how should i increase my crawl page in google i createad xml and html sitemap also and i submitted to google webmaster tool also . is any other solution is there to increase the pages in google please help me in this matter
Depending on the number of pages you have on your site, Google will take time to completely crawl it all. So don't worry. As long as you have good sitemap file, Google will see it all.
Did you ensure there are no pages containing very similar in contents and titles? SE will usually ignore them in this scenario, also good linking structure is the key for SE bots to navigate and crawl thoroughly big sites like yours..
I have the same problem in one of my site. I would like for google to index all my site (about 3500 pages)
Like wishbone says, if the content is very similar, titles, meta's and page content, then Google may only index a single version of the pages that it considers similar, though for this to be the case the pages would have to be almost identical with very few changes, particularly in the main content. If the content on all pages is all unique then it something else and the best thing to do is sign up with Google webmasters central (http://www.google.com/webmasters/) and upload a sitemap for your entire site, you can generate a sitemap to upload here: http://www.xml-sitemaps.com/ Good luck Phil
site: command is not really accurate.. you can try building more links to your inner pages.. it helps to index your other pages.. by the way it also depends on your site link structure.. make sure it is bot friendly..
Also try pinging the URLS that are not yet indexed ! Try also to do a little bit of blogcommenting on HIGH PR Do-follow blogs but don't go overboard.
Just Make sure that you follow these..\ - Title of each page is different. - you are updating each page frequently. - You have given Google enough time to crawl.
Link your each article accordingly.. The very first article linking to the second page then the second page linking back to the third page and so on.. This is easier to do if you apply it earlier..
20,000 urls, would you like to share your site with us. I would really want to have a look of the site which has 20k urls and only 200 are indexed in google !!!
my site has more then 50.001 links and google says he can't accept such a big sitemap... he suggests i should split that in 2 pieces... how ?
You may consider these options 1. Link Building - You should done it for both homepage and inner page (aka. deep link building). 2. Internal Linking - Check out to see if you are currently optimizing internal linking structure enough. 3. Social Bookmark - This could help your inner pages for fast index but a short period only. Overdoing it could lead you website being banned from social bookmark permanently, so use it cautions.
I agree with all of this, also take into consideration the amount of outside links pointing to your site, this increases the importance of it to google and will crawl it more frequently.
You should change the content of your site with some specific interval & you should also change meta & other tags accordingly.. So from that google will crawl you site more frequently..!!