Ok, I'm looking to redo my site's robots.txt and .htaccess files... Can anyone post a link to a QUALITY robots.txt tutorial or cheat-sheet? I've tried searching but always come up with adsense-filled pages with low-quality information. Thanks
I find the information provided by the robots.txt organisation sometimes too limited. The Web Developer's SEO Cheat Sheet from SEOmoz is better and I can also recommend Anton Shevchuk's SEO Cheat Sheet (PDF).