Need help in VB.Net

Discussion in 'Programming' started by James Edwards, Feb 3, 2009.

Thread Status:
Not open for further replies.
  1. #1
    I need someone who can tell me how to code a software that can scrap/harvest particular contents from a site, example harvesting titles of the games from a particular url.

    Regards
    James
     
    James Edwards, Feb 3, 2009 IP
  2. w0tan

    w0tan Peon

    Messages:
    77
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    0
    #2
    First you'll want to download the web page to a temporary variable. You can do this a number of ways, google will give example code.

    Next you use regular expressions to parse through the document. You'll find the info for that from the MSDN docs for the System.Text.RegularExpressions namespace.

    Regular expressions provide a way for you to tell the computer to search through the document in complex ways. Such as finding the text between the two bold tags in the main_column div.
     
    w0tan, Feb 4, 2009 IP
  3. codecre8r

    codecre8r Well-Known Member

    Messages:
    148
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    128
    #3
    If you want a really simple solution, check out WebZinc: http://www.webzinc.com/online/

    This component costs $99, but it's well worth it if you plan to create several scraping applications. I use this component at work for some API integration projects and it cuts my development time way down.
     
    codecre8r, Feb 4, 2009 IP
Thread Status:
Not open for further replies.