Robot ALL YOU MOTHA!

Hehe, ok, do I need to have Robot All in my meta tag for a crawler to visit all the pages?

Thanks a lot,

John S.

 

No, and if you have no experience in this area I would suggest not having a robots file at all. I see so many posts where nebies have made a mistake and did their indexing cause damage.

If there is no robots file, the search engines will take that as an open invitation to index all files

 

I think he means a robots meta tag, not a robots.txt
No you dont need it.

 

Thank you very much "yfs1" and "darksat", you were both a great help, if you ever have a question about vBulletin or vBadvanced, those are my two strong catagories. I feel so lame just asking question and not answering any =( .

Thanks again guys!