I wrote mod_rewrite for my site. Here is my .htaccess file: ========================================================= Options +Indexes Options +FollowSymlinks RewriteEngine on RewriteBase / RewriteRule ^county/([^.]+)-([^.]+)\.html$ counties.php?state=$1&county=$2 RewriteRule ^city/([^.]+)-([^.]+)\.html$ cities.php?state=$1&city=$2 RewriteRule ^zipcode/([^.]+)\.html$ zipcodes.php?zipcode=$1 [L] RewriteRule ^state/([^.]+)\.html$ states.php?state=$1 [L] ========================================================= Everything works fine when I browse my website. You can visit and check out at: http://www.cityfactsusa.com But the problem is when I try to create sitemap, it only create 1st level (states) URLs, does not scan deeper links (such as cities, counties or zip codes). So I only get 50 links in my sitemap. I tried various sitemap creator programs with the same result. I don’t get any error message either. Google also indexed my 1st level 50 pages. What I am doing wrong here? Mod_rewrite gurus, please help me solve this problem.
I am using free sitemap makers. So you don't see any problem with mod_rewrite ? Why google is only indexing 50 pages?
Change the URLs back to the non-mod-rewrite version and see if the script does the same thing. Then change back to mod_re-write. You can add \ before the two -'s but it probably won't fix it.
I am using SOFTplus GSiteCrawler and it does create full sitemap non-mod-rewrite version of my site? Any thought / workaround?
I'm not sure why it only does it with out mod_rewrite. If it's a text file, do a mass search and replace changing the old URLs to mod_rewrite.
Hey there. Have you been trying to generate your own Sitemap? If so, maybe its an error of yours. I'd really suggest, if you haven't already tried, a sitemap generator. I myself use Site Maps Pal, and it seems to do a very good job creating a sitemap. I hope that maybe the link I provided can help you out. If not, I'd listen to Nintendo and check over everything.
I can do this but I am worried that big G will not able to find my all pages. It’s been few weeks Google indexed first 50 pages; it is not indexing anymore….my guess is it the same reason I could not create Sitemap.