Anybody know how to make zip and pdf files so they won't be indexed by the searchengines? This can be done with the robots.txt file right? Can I do it from the control panel of my webhost? Thanks
In the html root of your site, put a robots.txt file. It will look something like this User-agent: * Disallow: /folder name where the files will be/ Sign up for a google webmaster account. And if google does index the files, you can make a submission to have to files removed from googles index. Also, to stop people from browsing the folder, put a blank index.html file in it. That way if someone types in the directory name, they will see a blank page, instead of a list of all your files.