What robots.txt for proxies?

Discussion in 'robots.txt' started by mybizhits, Jun 20, 2008.

0
  1. #1
    Please list all robots.txt that you should use
    for your proxy site.
     
    mybizhits, Jun 20, 2008 IP
  2. manish.chauhan

    manish.chauhan Well-Known Member

    Messages:
    1,682
    Likes Received:
    35
    Best Answers:
    0
    Trophy Points:
    110
    #2
    User-agent: *
    Disallow: /browse.php
     
    manish.chauhan, Jun 21, 2008 IP