Robots

Hi everyone, I am a newbie and what I want to know is what is robot?? I often see people use it on their site..What is the use of it? Thanks

 

A robot (often called a spider) searches through your site and indexes all the pages. It's how search engines and things get all the pages.

robots.txt controls which spiders to let in and which not to let in.

 

Oh thanks for the brief explanation, I start to get it now
So how can I make this robot?
I ever see one in google webmaster tool but I really don't know how to use it..please help me

 

Depends on what you want to do.

It's best explained on their website:
http://www.robotstxt.org/

 

Thanks for the info, I'll try to check the site first..if there is anything I dun understand yet, I will ask again later