ho to protects directory from being scanned ???

Discussion in 'Directories' started by Goonline, Apr 30, 2006.

0
  1. #1
    How to protect from un wanted spiders and bots

    Like all the download sites software
     
    Goonline, Apr 30, 2006 IP
  2. mystikmedia

    mystikmedia Jedi Master

    Messages:
    5,564
    Likes Received:
    498
    Best Answers:
    0
    Trophy Points:
    270
    #2
    Using your htaccess file...
     
    mystikmedia, Apr 30, 2006 IP
  3. Mystique

    Mystique Well-Known Member

    Messages:
    2,579
    Likes Received:
    94
    Best Answers:
    2
    Trophy Points:
    195
    #3
    Mystique, Apr 30, 2006 IP
  4. Goonline

    Goonline Well-Known Member

    Messages:
    239
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    130
    #4
    thank you

    we will try wor somthing
     
    Goonline, Apr 30, 2006 IP
  5. dvduval

    dvduval Notable Member

    Messages:
    3,372
    Likes Received:
    356
    Best Answers:
    1
    Trophy Points:
    260
    #5
    I think robots.txt would be a good start.
    Search for robots.txt and see what you come up with.
     
    dvduval, Apr 30, 2006 IP
  6. Goonline

    Goonline Well-Known Member

    Messages:
    239
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    130
    #6
    Thank you i will
     
    Goonline, May 1, 2006 IP
  7. guybrush

    guybrush Peon

    Messages:
    88
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #7
    The title of the thread totally fooled me.

    Seriously thought that some escort had also started providing spider-limiting services besides their usual ones. :)
     
    guybrush, May 4, 2006 IP