I'm using WordPress. I have 3 directories outside of my wp-content directory and it appears that Google can’t index them? The directories include: http://www.search-this.com/search-engine-decoder/ http://www.search-this.com/pagerank-decoder/ http://www.search-this.com/tools/ This is my robots.txt file: User-agent: * Disallow: /cgi-bin/ Disallow: /logs/ Disallow: /wp-admin/ Disallow: /wp-includes/ What’s up? How come Google can’t index what’s outside of wp-content ? I'll give 10 bucks to anyone who can figure out why these pages are not being indexed. Cause, I don't have a clue. thanks, Mark
I believe search engines become very cautious when they bump into words like "directory" or "search" ... that's why I would never get a domain name with the word "search" inside ( I already got one and nothing would get indexed ).
eldel - don't take this personally, but that is the dumbest thing I have heard in a long time. Google has indexed all my other pages, save these three. What do the three have in common? They are all outside of the wp-content directory...