1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Forum Stealer Tool?

Discussion in 'Products & Tools' started by craze3, Mar 7, 2007.

  1. #1
    What would people think of a spider-like tool in which you feed it a URL for a forum or message board, and it starts scraping and saving all the users, posts, threads, and categories into a mysql database that can easily be imported into your own forum?
    It would basically take everything from a forum and save it for you in a format which you can import into your own forum.
    Would this be beneficial at all? Would it be fair? Could you get in trouble?
    Just curious since the idea came to me while reading another thread..
     
    craze3, Mar 7, 2007 IP
  2. Kalyse

    Kalyse Peon

    Messages:
    1,221
    Likes Received:
    24
    Best Answers:
    0
    Trophy Points:
    0
    #2
    I thought about something like this. It would be great... if its possible to code without nuking both your server and the victim server.

    Such tools exist to create standard files.. but not that automatically make the posts...

    Are you thinking of making it?
     
    Kalyse, Mar 7, 2007 IP
  3. Volknet

    Volknet Peon

    Messages:
    609
    Likes Received:
    10
    Best Answers:
    0
    Trophy Points:
    0
    #3
    I think it's a bit unethical. It would load the persons server down quite a bit.
     
    Volknet, Mar 7, 2007 IP
    Smyrl likes this.
  4. craze3

    craze3 Well-Known Member

    Messages:
    454
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    110
    #4
    It does seem unethical. Would this be considered blackhat?
    Anyways, yes, if it were web based I could code it, but it might take up alot of bandwidth on both servers =/
     
    craze3, Mar 7, 2007 IP
  5. Kalyse

    Kalyse Peon

    Messages:
    1,221
    Likes Received:
    24
    Best Answers:
    0
    Trophy Points:
    0
    #5
    It sounds a bit like blog scrapers anyway. Which already exist. Blog posts are usually better quality then forum posts thats all.
     
    Kalyse, Mar 7, 2007 IP
  6. Red_Virus

    Red_Virus Well-Known Member

    Messages:
    3,756
    Likes Received:
    249
    Best Answers:
    0
    Trophy Points:
    135
    #6
    Hmm... this sounds really intresting.. will be a great tool to have//
     
    Red_Virus, Mar 8, 2007 IP
  7. nightmaster

    nightmaster Peon

    Messages:
    68
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #7
    This is stealing.
    Think this is violating copy rights. Could get to court.
     
    nightmaster, Mar 8, 2007 IP
  8. *Mayank*

    *Mayank* Notable Member

    Messages:
    2,154
    Likes Received:
    187
    Best Answers:
    0
    Trophy Points:
    280
    #8
    In short - Ridiculous!

    To be more precise - Sucks!
     
    *Mayank*, Mar 8, 2007 IP
    Nick_Mayhem likes this.
  9. David M

    David M Peon

    Messages:
    11
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #9
    Screw the server and would screw you with legal issues, theres already applications like this out there.
     
    David M, Mar 8, 2007 IP
  10. samantha pia

    samantha pia Prominent Member

    Messages:
    4,639
    Likes Received:
    482
    Best Answers:
    0
    Trophy Points:
    310
    #10
    there is a tool, infact i had it on my old site, that builds a search for your site, by crawling your server, it is a spider, and it can be used to crawl any website you wish, and it was free or linkware when i used it.
    it indexed the whole site and build a search and placed all the stuff in a database, it could be run from cronjobs too, or just from the admin pannel. but it would crawl any server/site you pointed it too, and yes it did take hours to index a 10,000 page site.
     
    samantha pia, Mar 8, 2007 IP
  11. Your Content

    Your Content Banned

    Messages:
    1,096
    Likes Received:
    45
    Best Answers:
    0
    Trophy Points:
    0
    #11
    Yes, there is a blog out there which created those spiders to find vulnerabilities on sites that allow retrieve other's content and databases.

    Not sure where the blog is located but I know how the spiders are called so here they are if someone wants to do a research on this matter:

    WebVulnCrawl
    WebVulnScan
     
    Your Content, Mar 8, 2007 IP
  12. craze3

    craze3 Well-Known Member

    Messages:
    454
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    110
    #12
    That would be to hack into the database and steal information.
    The method I was suggesting was a crawler to just scan and scrape info off pages.
     
    craze3, Mar 8, 2007 IP
  13. Your Content

    Your Content Banned

    Messages:
    1,096
    Likes Received:
    45
    Best Answers:
    0
    Trophy Points:
    0
    #13
    In such case you may try an offline browser, there are lots of them at www.download.com and they basically download all what they find available as public resource in most websites, unless it's a robots.txt preventing the access.

    However putting the content into a database requires manual coding :rolleyes:
     
    Your Content, Mar 8, 2007 IP
  14. jdR!pper

    jdR!pper Peon

    Messages:
    4,974
    Likes Received:
    564
    Best Answers:
    0
    Trophy Points:
    0
    #14
    The tool sounds good but I don't think it's good to use it. It's just plain ripping off.
     
    jdR!pper, Mar 9, 2007 IP
  15. EGS

    EGS Notable Member

    Messages:
    6,078
    Likes Received:
    438
    Best Answers:
    0
    Trophy Points:
    290
    #15
    I'd fuck someone up for doing that crap...that's just fucked up.
     
    EGS, Mar 9, 2007 IP
    Nick_Mayhem likes this.
  16. Kalyse

    Kalyse Peon

    Messages:
    1,221
    Likes Received:
    24
    Best Answers:
    0
    Trophy Points:
    0
    #16
    People do it to blogs every day. I bet half of your blogs are already copied by RSS readers and then psoted elsewhere.
     
    Kalyse, Mar 9, 2007 IP
  17. plumsauce

    plumsauce Peon

    Messages:
    310
    Likes Received:
    13
    Best Answers:
    0
    Trophy Points:
    0
    #17
    While it is technically possible, my opinion is that it is unfair, unethical and ... lazy.
     
    plumsauce, Mar 9, 2007 IP
  18. jhmattern

    jhmattern Illustrious Member

    Messages:
    8,909
    Likes Received:
    794
    Best Answers:
    2
    Trophy Points:
    455
    #18
    There's a really big difference between RSS feeds where the copyright holder is choosing how much information to make available, and scraping the full text of an entire forum w/o the consent of the forum owner or posters; one of whom owns the legal rights to the text, depending on the forum.
     
    jhmattern, Mar 9, 2007 IP
    Nick_Mayhem likes this.
  19. Nick_Mayhem

    Nick_Mayhem Notable Member

    Messages:
    3,486
    Likes Received:
    338
    Best Answers:
    0
    Trophy Points:
    290
    #19
    This tool would get you directly in court.

    Imagine you piping out the data from some forum.

    You also fetch the copyrighted materials from there. And that break the copyrights.

    EX: I write my own articles specially for DP forums, For Namepros and other places.

    They are unique and they only reside on that particular forum. Consider it as my contribution towards the community or anything but I leave a small Copyright notice in the end of that post.

    Same can be the case with the forum owner himself. What if he has written some guide and some points on his forum for benefit of his users.

    Now if that gets stolen he will surely turn red.
     
    Nick_Mayhem, Mar 10, 2007 IP
    jhmattern and *Mayank* like this.
  20. the Patrician

    the Patrician Well-Known Member

    Messages:
    253
    Likes Received:
    23
    Best Answers:
    0
    Trophy Points:
    110
    #20
    I'm sure someone out there can or has made something like this. Might as well name it "VAMPIRE" as it would be designed to suck the life force out of real humans' efforts so as to feed a lazy, unethical slob who can only live on the talents of others. :mad:

    I've got a "Tool" that's just right for this - A Big Pointy Stake to shove in any blackguard's heart that would rather steal that create for themselves.:D

    I am sure there are legal recourses to use against these "scapers" (bottom feeders) when one finds their work posted somewhere they didn't offer it to. So I would hope fellow posters will be forthcoming in letting the rest of us know how to end this type of intellectual abuse. :cool:
     
    the Patrician, Mar 10, 2007 IP