1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Dealing with bad bots...

Discussion in 'Site & Server Administration' started by SERPalert, Oct 4, 2005.

  1. minstrel

    minstrel Illustrious Member

    Messages:
    15,082
    Likes Received:
    1,243
    Best Answers:
    0
    Trophy Points:
    480
    #21
    See two posts above, cgo.
     
    minstrel, Nov 1, 2005 IP
  2. frankm

    frankm Active Member

    Messages:
    915
    Likes Received:
    63
    Best Answers:
    0
    Trophy Points:
    83
    #22
    If you are on a unix box, you can deny all traffic from a single IP address with:
    
    route add 155.207.131.48 reject
    
    Code (markup):
    (that's actually the last IP address I blocked)
    they will think the server is down or something but actually just can't connect to my servers at all

    if you are using .htaccess you can send a 403 No Access message, that still uses some bandwidth but a whole lot less than your normal pages by adding

    <Location />
    Order allow,deny
    Allow from all
    Deny from 1.2.3.4
    </Location>


    Edit: or see 3 posts ago :) missed that one minstrel
     
    frankm, Nov 1, 2005 IP
  3. cgo85

    cgo85 Peon

    Messages:
    380
    Likes Received:
    8
    Best Answers:
    0
    Trophy Points:
    0
    #23
    okay... made the changes you suggested Minstrel... One last thing, is this a valid .htaccess page then:

    ErrorDocument 404 http: // www. abcd. org

    <Limit GET POST>
    order allow,deny
    deny from 68.58.242.24
    allow from all
    </Limit>

    Options +FollowSymLinks
    RewriteEngine on
    RewriteRule resources-(.*)-(.*)\.html$ /more_resources.php?state=$1&city=$2
    RewriteRule category-(.*)-(.*)-(.*)\.html$ /y.php?sub=$1&state=$2&cat=$3
    RewriteRule city-(.*)-(.*)-(.*)\.html$ /c.php?sub=$1&state=$2&city=$3
    RewriteRule directory-(.*)-(.*)\.html$ /y.php?sub=$1&state=$2
    RewriteRule sitemap-(.*)\.html$ /sitemap.php?sub=$1
     
    cgo85, Nov 1, 2005 IP
  4. minstrel

    minstrel Illustrious Member

    Messages:
    15,082
    Likes Received:
    1,243
    Best Answers:
    0
    Trophy Points:
    480
    #24
    I'm too tired to read and vouch for all that RewriteRule stuff but the rest should be fine.
     
    minstrel, Nov 1, 2005 IP
    cgo85 likes this.
  5. frankm

    frankm Active Member

    Messages:
    915
    Likes Received:
    63
    Best Answers:
    0
    Trophy Points:
    83
    #25
    You can check if it does what it should do (about the blocking) by just adding your own IP address for a while and try to access your site.
     
    frankm, Nov 1, 2005 IP
    cgo85 likes this.
  6. cgo85

    cgo85 Peon

    Messages:
    380
    Likes Received:
    8
    Best Answers:
    0
    Trophy Points:
    0
    #26
    yeah... the rewrite is fine. I was just wondering if that was a valid .htaccess. Didn't know if you couldn't combine too many things on it or something... Thanks for your help, really appreciate it!
     
    cgo85, Nov 1, 2005 IP
  7. Smyrl

    Smyrl Tomato Republic Staff

    Messages:
    13,740
    Likes Received:
    1,702
    Best Answers:
    78
    Trophy Points:
    510
    #27
    Internetseer offers a web monitoring service.

    Shannon
     
    Smyrl, Nov 1, 2005 IP
  8. minstrel

    minstrel Illustrious Member

    Messages:
    15,082
    Likes Received:
    1,243
    Best Answers:
    0
    Trophy Points:
    480
    #28
    :confused:

    InternetSeer does offer a free site checking service to tell you if your site is down.

    Did you mean he could use that to see if his site is accessible, Shannon?
     
    minstrel, Nov 1, 2005 IP
  9. Smyrl

    Smyrl Tomato Republic Staff

    Messages:
    13,740
    Likes Received:
    1,702
    Best Answers:
    78
    Trophy Points:
    510
    #29
    Yes, I used the free service on an e-commerce site. To me their bot is not necessarily a bad bot.

    Shannon
     
    Smyrl, Nov 1, 2005 IP
  10. minstrel

    minstrel Illustrious Member

    Messages:
    15,082
    Likes Received:
    1,243
    Best Answers:
    0
    Trophy Points:
    480
    #30
    No, no. I also use the service to warn me when my sites are down or timing out.

    What I meant was how will that help cgo?
     
    minstrel, Nov 1, 2005 IP