1. 

   catilucky Peon

   Messages:

   55

   Likes Received:

   1

   Best Answers:

   0

   Trophy Points:

   0

   #1

   what is robots.txt anybody tell me and give some examples
   

    

   catilucky, Aug 2, 2010 IP
   
2. 

   zacharooni Well-Known Member

   Messages:

   346

   Likes Received:

   20

   Best Answers:

   4

   Trophy Points:

   120

   #2

   Robots.txt is a facility to control what web spiders and crawlers see and do not see. For more information, you can visit http://en.wikipedia.org/wiki/Robots_exclusion_standard

    

   zacharooni, Aug 3, 2010 IP

• Log in with Facebook

Your name or email address:

Do you already have an account?

• No, create an account now.
• Yes, my password is:
• Forgot your password?

Stay logged in