Hello. I would like to disallow access to /images/ and directories under it. But I would like to allow access to one directory that is under /images/. Any idea how I would allow this? Or is it just impossible?
Actually if you disallow access to /images/ then you are disallowing access to the files inside of it, isn't it?
What you're wanting to do is possible - provided the bots recognize the "allow" command - googlebot and yahoo's slurp definitely do. Disallow: /folder1/ Allow: /folder1/myfile.html bans bots from all of folder1 except for myfile.html Disallow: /images/ Allow: /images/folder1/ should do the trick for you. p.s. I've not done this personally.