i have a site with a blog and forum, i started my forum around 10 days ago and currently the sitemap is a wordpress plugin which generates a sitemap of only the blog. After 10 days and having only the index page of my forum get indexed in and out of the SERPs i decided to add all the forum urls as well to the sitemap, but i tried with 2 sitemap generators and they didnt index anything from my forum directory. Am i missing something here? PS - my forum is on phpbb3 and bots have been given 'bot access'. please help!
Have you tried A1 Sitemap Generator? Feel free to email/PM me about any problems. Alternatively, you could post your website URL here.
signature..still same prob..i think its what causing my forum not to be indexed by google, blog posts get indexed in a few mins while forum posts after weeks haven't still been indexed.
You don't make sure to redirect non-www to www URLs in your forum. http://www.computer-realm.net/community/ http://computer-realm.net/community/ Your signature had non-www, but your website seems to use www. That may be your problem depending on how you set root when scanning website. At least it will cause problems later on with duplicate content/pages in search engines. Anyways, I ran a quick test and seemed to me forum was crawled OK. But that was with the latest beta of A1 Sitemap Generator 1.8.0, I will probably test later with 1.7.9 as well just to make sure.
I just found out the second reason. When crawling with A1 Sitemap Generator it detects all viewforum urls encountered as "nolist" / "noindex" ... I believe because of your robots.txt wildcards: Disallow: /*?* Disallow: /*? At least how A1SG currently handles robots.txt wildcards it's a problem. I believe A1SG handles robot file wildcards correctly... And if you are saying search engines don't index your website, conclusion probably is it's your robots.txt that is causing the problems
If you have Feed on your blog or Forum,try to insert Feed adress on place of sitemap created by sitemaps. I had same this problem with my one blog, i delete sitemap and inserted my feed adress which google indexed easily.Some time really understandable situation,as you can see bellow my blog adress, its one blospot, usualy google index blogspot within minutes, but i have passed one week and still its under waiting queque. Soif no solution,than be patient, maybe little more later would be fine,otherwise try to atom.xml on place of sitemap.xml. Good luck.
thanks for the info everybody, didn't check this thread for a while, still same problem. , i'll try both these changes and see if it fixes it. thanks.