Something's Crawling My vB Forum And I Don't Know What It Is?

Discussion in 'Forum Management' started by Dio, May 10, 2007.

  1. #1
    Not sure what's going on here. I run a vB forum on one of my sites - I'm looking at the logs and the bandwidth has shot up from 15 MB's a day (yes that's quiet) to 400MBs. I can't see any pages in the site that are getting hit, or any obvious referrers in the log.

    This seems to be the problem:

    207.210.112.19 Pages: 26429 Hits: 26445 BW: 616.51 MB

    And the file that's got the biggest traffic is: /forums/showthread.php

    There's nothing in the bots section that matches that sort of file transfer and like I say, there's no obvious referrer that I can spot. I'm stumped as to what's happening. Any ideas? Am I being scraped or something? The IP address 207.210.112.19 doesn't seem to be anything other than a web host?

    I've blocked it for now, but I'm at a loss as to what it is and why it's needed to eat up over 600mbs of bandwidth.
     
    Dio, May 10, 2007 IP
  2. ThatForumPlace

    ThatForumPlace Peon

    Messages:
    201
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Could be some sort of website downloader that's defective and stuck on repeatedly downloading the same file.

    Odds are, you might never find out what it is - I'd just stick to the IP ban you put in place, cross your fingers, and hope it never happens again.
     
    ThatForumPlace, May 10, 2007 IP
  3. Dio

    Dio Well-Known Member

    Messages:
    725
    Likes Received:
    55
    Best Answers:
    0
    Trophy Points:
    120
    #3
    I took a look at the log file, and it's looks like its followed every link on the site, all sorts of query strings are there so I think the weight may be because it's hit the same content over and over by lots of different iterations of the URL. The IP ban is a fairly moot thing - they could have been spoofing it to start with - I'd just like to know what they were up to. :D
     
    Dio, May 10, 2007 IP
  4. webhostingoffers

    webhostingoffers Guest

    Messages:
    171
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    0
    #4
    its probably someone stealing posts and content off your site by using a ripper
     
    webhostingoffers, May 10, 2007 IP
  5. allout

    allout Prominent Member

    Messages:
    5,000
    Likes Received:
    461
    Best Answers:
    2
    Trophy Points:
    340
    #5
    i
    That was what I was going to post. I think it is some kind of program stealing information to repost somewhere else.
     
    allout, May 10, 2007 IP
  6. Dio

    Dio Well-Known Member

    Messages:
    725
    Likes Received:
    55
    Best Answers:
    0
    Trophy Points:
    120
    #6
    Ah, well, as long as they leave my affiliate links intact... :D
     
    Dio, May 10, 2007 IP
  7. allout

    allout Prominent Member

    Messages:
    5,000
    Likes Received:
    461
    Best Answers:
    2
    Trophy Points:
    340
    #7
    That would be nice, but most of the time they are stealing postings and content and some mix them up to look original and others just copy word for word without the links.
     
    allout, May 10, 2007 IP
  8. dougeetx

    dougeetx Peon

    Messages:
    226
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #8
    dougeetx, May 10, 2007 IP
  9. Endurer

    Endurer Well-Known Member

    Messages:
    1,113
    Likes Received:
    84
    Best Answers:
    0
    Trophy Points:
    140
    #9
    Could this be that omgili bot? or someone using httrack?
     
    Endurer, May 10, 2007 IP
  10. yogesh sarkar

    yogesh sarkar Well-Known Member

    Messages:
    1,740
    Likes Received:
    75
    Best Answers:
    0
    Trophy Points:
    140
    #10
    207.210.112.19 UNITED STATES GEORGIA ATLANTA GLOBAL NET ACCESS LLC www.gnax.com either block this ip or contact the ISP and lodge a complain.
     
    yogesh sarkar, May 10, 2007 IP