Some help please...

[cgo85]

Can someone tell if this is a valid robots.txt:

User-agent: Teoma
Disallow: /
User-agent: psbot
Disallow: /
User-agent: appie
Disallow: /
User-agent: Accoona-AI-Agent/1.1.1
Disallow: /
User-agent: askjeeves
Disallow: /


This doesn't seem to be working. Your help is appreciated.

[minstrel]

What do you mean when you say "this doesn't seem to be working"?

What that file is doing is instructing a limited number of spiders (user agents)to NOT index the entire site. All remaining spiders, by default, are given permission to index the entire site. Is this what you intended to do?

Usually, you would leave a blank line between successive user-agent instructions but I must admit I don't know if spiders carfe or if this is usually done to improve readability for humans.

[Integrov]

i thinks that means that you are restricting each of the search engines you had listed...

if you wanted to do so, then the standard is to put a newline between each disalow...