Unknown Bots eating up my valuable bandwidth!! How to stop!!

Discussion in 'Site & Server Administration' started by life31, Jun 9, 2009.

  1. #1
    [​IMG]

    If you see the above screenshot of my bandwidth usage. You can see the maximum number of bandwidth used by unknown bots.

    What I wanted to confirm was are these of any use?? If not how do I stop them from eating up my valuable bandwidth.
     
    life31, Jun 9, 2009 IP
  2. vasyl

    vasyl Peon

    Messages:
    138
    Likes Received:
    5
    Best Answers:
    0
    Trophy Points:
    0
    #2
    review logs to determine if they're coming from the same IPs - so you can cut them by IP
     
    vasyl, Jun 9, 2009 IP
  3. life31

    life31 Active Member

    Messages:
    1,024
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    78
    #3
    Cant detect exactly. Detected some stuffs but not sure its cos of that??

    One Ip seems to be of Worldcall Telecom Ltd pakistan, other of RIPE Network Coordination Centrea and third one of my own host. There are repeated huge number of hits from these three.

    Surprising part is why does my own hos ip show up?? Does that mean that ther's some fault in the script or plugin used?
     
    life31, Jun 9, 2009 IP
  4. RHS-Chris

    RHS-Chris Well-Known Member

    Messages:
    1,007
    Likes Received:
    35
    Best Answers:
    10
    Trophy Points:
    150
    #4
    You can block by detecting the User Agent, through .htaccess:

    RewriteEngine on 
    RewriteCond %{HTTP_USER_AGENT} ^$
    RewriteRule ^.* - [F] 
    Code (markup):
    That should work.
     
    RHS-Chris, Jun 9, 2009 IP
  5. life31

    life31 Active Member

    Messages:
    1,024
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    78
    #5
    But how do I confirm if they are of any use to my site or they are just useless.
     
    life31, Jun 9, 2009 IP
  6. hatblack

    hatblack Peon

    Messages:
    67
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #6
    Download a list of useful bots and remove the others
     
    hatblack, Jun 9, 2009 IP
  7. life31

    life31 Active Member

    Messages:
    1,024
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    78
    #7

    How do I specify an ip address with this
     
    life31, Jun 11, 2009 IP