How to get large numbers of pages indexed in Google quickly?

Question for you webmasters with large sites:

What tips do you have for getting large sites spidered and indexed quickly? What inbound links are necessary? Any tips on internal navigation? Is the DP co-op effective for getting them indexed?

Thanks in advance!

 

Submitting a site map + pointing coop weight at internal pages has worked well for me

 

Yep, use Google sitemaps, and get back links, preferably to deper pages, not just your home page.

 

Thanks for the info!

So sitemaps actually work for getting large numbers of pages indexed? I have never actually used sitemaps before, but it would only take me 5 minutes to put one together so I guess it's worth a try...

Any more tips?

 

Maybe I am in the minority but I haven't felt the need to use google site map to index new pages. Remember that to get the page indexed, you simply need a backlink to that page and google will index it.

What I did is create a page ( just to put my url's I want to index in it ) and point to that page from my home page.

Once this page ( the one that has the urls ) is indexed, then all the url included in it will be indexed as well.

Have done that everytime I wanted to index a new page and worked nicely.. I am not sure what more benefit I can get from the google site map.

 

If you have a site that's visited by Google daily (I'm talking every few hours) then just put a link on your index page and it'll get indexed within a few days, sometimes less.

 

Alhoop, what you have done is create a sitemap.

You say you are not quite sure what benefit you can get from a sitemap, well then you maybe have no need for them. If done properly (and understood) a google sitemap not only tells the spiders that pages exists, it can tell them the ORDER OF IMPORTANCE of your pages! Stop and think about that for a moment. If you think that your product pages are the most important, then you can simply tell the spider this, and it will then act accordingly.

There is a LOT more to Googlesitemaps than a list of urls

 

Exactly, if you want to get a site containing over 50,000 pages creating a site map listing the priority of the pages goes a long way in getting all the pages of your sites indexed. For example, your homepage might lead to category pages and these category pages then lead to product pages, creating a site map which lists the category pages as more important and then pointing a few links to these pages will go a long way in getting your site indexed quickly.
I have used this technique to get sites over 30-40,000 pages indexed in a week's time.

 

I would say make a sitemap and make sure you update it at least 3 or 4 times so that the system notices some content is added and some content is getting older. The first sitemap for the second site in my signature took 3 Gb of bandwith but it's well worth it.

Post your site to directories so that you will get some backlinks, google will index your site faster if more links to your site are detected.

The first site in my signature has about 2700 pages and until I've started submitting to directories, google only indexed about 200.

From the moment I've finished submitting to the directories in the Villesilencer's list, googlebot started to index my site faster each day, more and more pages. Now about 2500 pages are indexed and google still crawls my site daily.

Also, some mod_rewrite doesn't hurt anyone, check the links on my two sites, it seems Google likes them and I don't feel they look back to people visiting my site.

Also, I think it's good to know that MSN will start crawling your site as soon as you mention the url on their site, it will really start working on your site from the moment you submit it to directories but in the long run it will eventually slow down.

Recently, I've noticed the Ask bot crawling my sites in an insane rithm but my second site does not even appear on their search engine..

 

That's an good Idea...

 

Heck, I submitted a google site map & only 6 of my pages are indexed since I submitted my sitemap on Oct 31 or on Halloween!

Here is my content site: www.erosrx.net

This site is only used for getting a better quality score from google adwords.

 

What kind of sitemap do you use. xml, text or can anybody tell me about ror files??

 

how fast and deep your site will be crawled and indexed is determined by page rank of site and internal pages...not sitemaps
you need high PR links to increase your site's PR if your main target is a fast indexation
stop giving advices from what you've heard or makes sense for you
that is how seo myths developed over the time..

 

Google Sitemap
Backlinks/Links from a website with higher PR(a PR 6+ page can get you indexed in less than 24 hours)
HTML/Static Pages - Dynamic Pages are not much loved by SEs

 

A word of advice: try not to become dependent on Gogle, they are not very dependable. Today you might have 30% of your pages indexed by Google tomorrow you might not have them show up in google searches anymore.

It's very arbitrary.

Google is very fickle with smaller sites that it can overpower.

 

woot? google indexed only 20 of your pages!

 

My site http://casinoparadise.blog.com/ is getting indexed by google 2 times a day.

 

Create a Sitemap.xml file and upload it your root directory then submit it to Google through Google Webmasters. All the pages of your sites will be indexed very soon.

 

what henry said. get sitemaps made and submit them

 

My site http://www.bankifscmicrcode.com has around 90000 pages but google indexed only 300 pages why?