Hey hi! If I set the permission on robots.txt file to 600 that is no one can read the file.. Will the search engine be able to read it and apply the instructions? I actually want to hide my product download folder from being indexed. How do I achieve that? Thank You!
First, why do you not want someone to read your robots.txt file? To block the SEs from indexing the folder User-agent: * Disallow: /productDownLoadFolder/ Or just don't have a link to enter the folder. Or use javaScript links to enter.