1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Stupid referer spammers

Discussion in 'Apache' started by 993ti, Nov 5, 2005.

  1. #1
    I've noticed an increase of referal spammers lately and got sick and tired of them.
    So, i've blocked the rats out.
    Here's the code for the htaccess for those who want it, including the lines for blocking bad bots and siterippers:
    RewriteCond %{HTTP_REFERER} profile.myspace\.com [NC,OR]
    RewriteCond %{HTTP_REFERER} comments.myspace\.com [NC,OR]
    RewriteCond %{HTTP_REFERER} www.myspace\.com [NC,OR]
    RewriteCond %{HTTP_REFERER} www.online-forex-trading-currency-exchange\.com [NC,OR]
    RewriteCond %{HTTP_REFERER} www.berlin-hotel-4u\.com [NC,OR]
    RewriteCond %{HTTP_REFERER} www.vinsider\.com [NC,OR]
    RewriteCond %{HTTP_REFERER} www.realtorlist\.net [NC,OR]
    RewriteCond %{HTTP_REFERER} www.vjackpot\.com
    RewriteRule .* - [F]
    RewriteCond %{HTTP_USER_AGENT} ^BlackWidow [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^Bot\ mailto:craftbot@yahoo.com [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^ChinaClaw [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^Custo [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^DISCo [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^Download\ Demon [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^eCatch [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^EirGrabber [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^EmailSiphon [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^EmailWolf [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^Express\ WebPictures [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^ExtractorPro [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^EyeNetIE [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^FlashGet [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^GetRight [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^GetWeb! [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^Go!Zilla [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^Go-Ahead-Got-It [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^GrabNet [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^Grafula [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^HMView [OR] 
    RewriteCond %{HTTP_USER_AGENT} HTTrack [NC,OR] 
    RewriteCond %{HTTP_USER_AGENT} ^Image\ Stripper [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^Image\ Sucker [OR] 
    RewriteCond %{HTTP_USER_AGENT} Indy\ Library [NC,OR] 
    RewriteCond %{HTTP_USER_AGENT} ^InterGET [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^Internet\ Ninja [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^JetCar [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^JOC\ Web\ Spider [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^larbin [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^LeechFTP [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^Mass\ Downloader [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^MIDown\ tool [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^Mister\ PiX [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^Navroad [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^NearSite [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^NetAnts [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^NetSpider [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^Net\ Vampire [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^NetZIP [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^Octopus [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^Offline\ Explorer [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^Offline\ Navigator [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^PageGrabber [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^Papa\ Foto [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^pavuk [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^pcBrowser [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^RealDownload [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^ReGet [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^SiteSnagger [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^SmartDownload [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^SuperBot [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^SuperHTTP [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^Surfbot [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^tAkeOut [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^Teleport\ Pro [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^VoidEYE [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^Web\ Image\ Collector [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^Web\ Sucker [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^WebAuto [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^WebCopier [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^WebFetch [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^WebGo\ IS [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^WebLeacher [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^WebReaper [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^WebSauger [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^Website\ eXtractor [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^Website\ Quester [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^WebStripper [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^WebWhacker [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^WebZIP [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^Wget [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^Widow [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^WWWOFFLE [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^Xaldon\ WebSpider [OR] 
    RewriteCond %{HTTP_USER_AGENT} ^Zeus 
    RewriteRule ^.* - [F,L]
    Code (markup):

     
    993ti, Nov 5, 2005 IP
  2. nicknick

    nicknick Peon

    Messages:
    429
    Likes Received:
    21
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Thank you. I'll try that code out. I've also been getting more spam lately and it seems to happen as soon as I put up an e-mail address on a page.
     
    nicknick, Nov 5, 2005 IP
  3. 993ti

    993ti Well-Known Member

    Messages:
    314
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    108
    #3
    Update on the sites:
    RewriteCond %{HTTP_REFERER} profile.myspace\.com [NC,OR]
    RewriteCond %{HTTP_REFERER} comments.myspace\.com [NC,OR]
    RewriteCond %{HTTP_REFERER} www.myspace\.com [NC,OR]
    RewriteCond %{HTTP_REFERER} www.online-forex-trading-currency-exchange\.com [NC,OR]
    RewriteCond %{HTTP_REFERER} www.berlin-hotel-4u\.com [NC,OR]
    RewriteCond %{HTTP_REFERER} www.vinsider\.com [NC,OR]
    RewriteCond %{HTTP_REFERER} www.realtorlist\.net [NC,OR]
    RewriteCond %{HTTP_REFERER} www.vjackpot\.com [NC,OR]
    RewriteCond %{HTTP_REFERER} accept-credit-cards.4all-credit\.com [NC,OR]
    RewriteCond %{HTTP_REFERER} credit-card.4all-credit\.com [NC,OR]
    RewriteCond %{HTTP_REFERER} credit-card-application.4all-credit\.com [NC,OR]
    RewriteCond %{HTTP_REFERER} www.poker4spain\.com [NC,OR]
    RewriteCond %{HTTP_REFERER} prescription-drugs.available-prescription\.com [NC,OR]
    RewriteCond %{HTTP_REFERER} www.vined\.com [NC,OR]
    RewriteCond %{HTTP_REFERER} car-loan-calculator.great-finance\.com [NC,OR]
    RewriteCond %{HTTP_REFERER} car-loans.great-finance\.com [NC,OR]
    RewriteCond %{HTTP_REFERER} vjuror\.com
    RewriteRule .* - [F]
    Code (markup):
    edit: Anyone have more referer spam sites to add?
     
    993ti, Nov 9, 2005 IP
  4. Smyrl

    Smyrl Tomato Republic Staff

    Messages:
    13,740
    Likes Received:
    1,702
    Best Answers:
    78
    Trophy Points:
    510
    #4
    You may want to add vjuror to list.

    Shannon
     
    Smyrl, Nov 9, 2005 IP
  5. 993ti

    993ti Well-Known Member

    Messages:
    314
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    108
    #5
    Ah, thx.
    I'll just update the second list for sites so the thread doesn't get cluttered with the same stuff all the time.
     
    993ti, Nov 9, 2005 IP
  6. dj1471

    dj1471 Well-Known Member

    Messages:
    97
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    116
    #6
    It's probably much better to look for key-words in the referrer string rather than specific sites. E.g. "poker", "shemale" etc.

    The spamvertised sites will change all the time, but they'll all have the same keywords in the URL.
     
    dj1471, Nov 13, 2005 IP
  7. TommyD

    TommyD Peon

    Messages:
    1,397
    Likes Received:
    76
    Best Answers:
    0
    Trophy Points:
    0
    #7
    I'm seeing errors in my logs(404) frompeople trying to access my cpanel url.

    Example Report:
    -------------------------------------------------------------
    Requested URL: /unprotected/images/top_02_2.gif
    Referring URL: http://www.mydomain.com:2082/frontend/x/stats/
    Requesting IP: 65.49.143.50
    Request Method: GET
    Requester Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.12)
    Gecko/20050915 Firefox/1.0.7
    Requester Host: CPE00095b36c3b9-CM000a7363db08.cpe.net.cable.rogers.com
    ----------------------------------------------
    I've tried and block specific requesters, but they a few attemps and then move onto another requester.

    Should I use .htaccess to block the requested url, and when I need to get into cpanel comment out the line blocking me?

    thx,

    tom
     
    TommyD, Nov 13, 2005 IP