My latest domain is http://www.youposted.com a SimpleMachines Forum (SMF), with no proper website. I've been going since the beginning of August and has 75,000 posts, 5000 topics, 800+ members. Anyway, I've been indexed ok by Yahoo, AllTheWeb and others. But Google refuses to spider any pages but the main index.php My site has legitimate links on some high ranking PR sites including Wikipedia, Gamespot, IGN and others. I've checked the PR and it is 0 (not suprising since its only indexing the very simple pages. I think it may be due to SMF having dynamic urls eg http://www.mysite.com/index.php?topic=1681.0 Although SMF does have an option for different urls (supposedly more SEO friendly), my server doesnt support it. They are adament that there is no reason why google shouldnt be able to spider it. Someone suggested a sitemap may help, so I've wrote a script to write one and I've registered on google sitemaps and uploaded it. They've downloaded the file at least twice I know of in the last 48 hrs and although I've seen google spider listed in my whos online, it doesnt seem to be adding any to its index. http://www.youposted.com/sitemap.xml (1.1MB) Anyone know where I'm going wrong?
I think it will often take somewhat longer for (that many) "low-priority" pages to be included in SERPs. Well, I can not say for sure, I just think 48 hours sound of relatively little time to wait
Thats ok, Iam using MyBb Forum. Is there any Plugins or scripts available wich can generate sitemap for MyBb Forums?
I do not know, but if your forum isn't huge, it should for the most part be ok to use a crawler instead given: You run it at a time your webserver isn't very busy (see webserver logs) You optimize crawler filers to leave out all unnecessary pages Set whatever other relevant options in website crawler / sitemap generator Hope and pray your forum backend DB is fast
I also have an SMF forum [which is in my sig] but I get indexed quite fast, just after 6 days I launched my site and did posted a couple in links in some blogs....Though I do agree that Yahoo indexes SMF better than google, google do indexed SMF as wel without any mod being installed...
codeber, you are using SMF 1.1 RC2 and i strongly believe that there should be no problem. Mine is smf 1.0.5 ( with a lot of customize mods and features ). I can't upgrade to the latest version unless i modify all those mods manually again. The main different between SMF 1.1 RC2 and smf 1.0.5 is SMF 1.1 RC2 "bypass" session id for spiders. Therefore, your site should be index well. All you need to do is try to get as much back links from other high pr sites ( which have the same keywords range ) Hope this help.