I have a fairly large forum with over 100k posts but only about 1k of them are being indexed by google. I don't understand why as it's a big forum and fairly old. any explanations?
i would work on getting some deep links to those parts of your site which might be considered 'hub' pages or that are particularly well visited or more valuable or important to you/your visitors. also, give a good/unique title and description to those pages that you want to have indexed and then manually submit some of them to google using their submit page, it takes a while but they do often get around to it. and as cutts said in a recent vid, the approx rate that google indexes a site and how much of it they index etc has a lot to do with pagerank. (and you can help circulate your page rank around you site by having good navigation and also the inbound deep links etc) and like cutts said in the useful vid linked to above, to get indexed more often and deeper, it's about becoming an 'authority' site and that means more (and more) quality links....
Yes it is but you need to do some work to help Googlebots index your site more efficiency. 1. Link Building - You should have done build links to both homepage and inner pages regularly. 2. Search Engine Friendly URL - Your forum url should have rewritten for more seo friendly and not a dynamic one. If your site use sessionid please avoid using it. Googlebots and other search engines bot do not like sessionid and most of page with sessionid will not be indexed. You may read more about this - URL Rewriting Guide - Apache HTTP Server or ask question directly about this at Mod_Rewrite Forums 3. Google Webmaster Tools - Get your site verified and submit your sitemap. This could help you in a long run. You would see the site index problem and the status of your sitemap in Googlebots perspective. Here is the shortcut - Google Webmaster Tools
This has obviously come from an experienced admin Thanks for your wonderful tips. Even if I have a website, I do keep adding new pages once every week, is it okay ?