I dont know the very basic thing about robots.txt

Please answer me these things.
1. where can I found robot.txt in my site.
2. Is there any way to stop showing bots online in a forum?

 

Your robots.txt file should be in your root directory.

If there is no any create one, it's easy: www.outfront.net/tutorials_02/adv_tech/robots.htm

Regarding your second question, depends on your forum software modify the setting to get rid of listing them.

Which script are you using?

 

I am using mybb.
And I didnt see the robot.txt anywhere in my site.

 

Well, create one.. at the link given above. As for the second question, i would suggest that you go ahead and ask the mybb support forums before asking here!

 

the robots.txt must exist in each directory of your site and also in each subdomain (of course if you have one).

for the beginning of your site for your robots.txt file to contain the following code :

after you got a huge number of visitors and you discover problems with spam bots or anything else... then it would be the right moment for you to spend on reading more advanced tips and tricks about robots.txt

don't take it personally but you should consider "Time" as the most important factor in developing your website.

 

A robots.txt is a file placed on your server to tell the various search engine spiders not to crawl or index certain sections or pages of your site. You can use it to prevent indexing totally, prevent certain areas of your site from being indexes or to issue individual indexing instructions to specific search engines.

 

Actually, the robots.txt file only needs to exist in the root directory of your site (and subdomains, of course).

http://www.example.com/robots.txt

is all you need.

 

you don't always have one you may have to make one.

 

on this site it says "2. The next thing we want to do is to prevent Alta Vista from getting in there at all." i was wondering why you would want to ban such a big search engine.

it also says about blocking google from indexing your images why would you want to do that

 

i strongly suggest you to read official robots.txt web site. it's robotstxt.org

 

so you need one to make a search engine pick up your website?