Data Scraping

Discussion in 'Programming' started by snous, May 2, 2010.

  1. #1
    I operate a niche job site. Right now I'm manually adding jobs to my listings & its not scalable. I want to automate & take the legwork out of some of this by using a data scraper. Right now my process is to visit each company's career page & copy & past the jobs into my site.

    Does anyone know of any data scrapers that would help me automate this process or how to build one? I'm thinking I'd like to export the data in xml, so I can have my site read the xml file.

    Let me know if anyone can help.

    Thanks!
     
    snous, May 2, 2010 IP
  2. Swaggar

    Swaggar Greenhorn

    Messages:
    89
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    18
    #2
    Look into the scripting version of Imacros. It scrapes well, but it does have a learning curve.
     
    Swaggar, May 3, 2010 IP
  3. ccoonen

    ccoonen Well-Known Member

    Messages:
    1,606
    Likes Received:
    71
    Best Answers:
    0
    Trophy Points:
    160
    #3
    Indeed.com has an api you can use for free :)
     
    ccoonen, May 4, 2010 IP