Restrict all bots access to my staging site

Discussion in 'Apache' started by greatlogix, Dec 13, 2007.

0
  1. #1
    how can i restrict all bots access to my staging site

    I put Following commands in .htaccess file but it gave me Internal Server Error

    User-agent: *
    Disallow: /

    How to fix it.

    Thanks,
    Waqas
     
    greatlogix, Dec 13, 2007 IP
  2. abdussamad

    abdussamad Active Member

    Messages:
    543
    Likes Received:
    17
    Best Answers:
    0
    Trophy Points:
    60
    #2
    put the above code in a file called robots.txt
     
    abdussamad, Dec 13, 2007 IP
    greatlogix likes this.
  3. greatlogix

    greatlogix Active Member

    Messages:
    664
    Likes Received:
    13
    Best Answers:
    1
    Trophy Points:
    85
    #3
    Thanks for help. Green rep to you
     
    greatlogix, Dec 18, 2007 IP