Disallow search bots beyond the root folder content

Hi,

I'm thinking that robots.txt is the one to do it, so here am I asking for some help. I am not sure if there will also be some work for .htaccess too.

What I want is to allow agents, search bots in the html/pages of a folder but not inside of any sub-folders (and their contents) inside that folder.

 

Take a look at this page. It might be what you're looking for.

http://www.robotstxt.org/wc/exclusion-admin.html

 

Thanks for the link.
However, I might have lots of sub-folders within that folder and I am not sure what would be their names. Thus I want kind of a automated system like this

Disallow: /rootfolder/*/

but here, the wild card is not allowed in robots.txt that is where the problem creeps in.

 

google and yahoo can understand wild card in robots.txt .

you can use wild card in robots.txt

 

Alright, so according to you, how would you write a robots.txt if you were in my situation?