Any scripts that 'scrape' CJ products?

Discussion in 'Commission Junction' started by butterfingers, Apr 29, 2007.

  1. #1
    Just like adsense, which scraped a lot of content.
    But in this case, a products of CJ affiliates.

    Preferably free.
     
    butterfingers, Apr 29, 2007 IP
  2. henryzeng

    henryzeng Peon

    Messages:
    199
    Likes Received:
    10
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Some cpa networks have the actual function as you refer, but I don't know if any script has this feature with cj.
     
    henryzeng, May 1, 2007 IP
  3. andre75

    andre75 Peon

    Messages:
    1,203
    Likes Received:
    45
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Those are not that hard to write.
    I wrote a script that logs into my CJ account and finds special deals on certain products for certain advertisers, groups them into product categories ...
    and then I got busy doing other things and never completed it.
    I do plan to get back and finish it some day in the future.
    I just don't want to update my affiliate links by hand every other day. Its too cumbersome. They gave me datafeeds for 5 advertisers, not that that makes a difference.
    Bottom line, its easy. Write one yourself.
     
    andre75, May 1, 2007 IP
  4. butterfingers

    butterfingers Well-Known Member

    Messages:
    1,142
    Likes Received:
    54
    Best Answers:
    0
    Trophy Points:
    128
    #4
    I'm not a coder, so it's kinda hard to understand and code by myself.
    : )
     
    butterfingers, May 1, 2007 IP
  5. andre75

    andre75 Peon

    Messages:
    1,203
    Likes Received:
    45
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Neither am I. I am an electrical engineer and photographer (funny combination I know).
    PHP is really easy to learn.
    I can recommend a book I bought online somewhere (pdf file, need to find the name) that basically shows you how to log in somewhere accept cookies and pretend to be a Firefox 2 :cool:
    From there on its straightforward. You just do everything with the browser and then try to replicate it with the script. Then you do a little bit of pattern matching http://php.net/preg_match and you are pretty much set.

    To answer your other question: Yes I hate MFA sites :D
     
    andre75, May 1, 2007 IP
  6. ahkip

    ahkip Prominent Member

    Messages:
    9,205
    Likes Received:
    647
    Best Answers:
    0
    Trophy Points:
    310
    #6
    Please find the book :D
     
    ahkip, May 2, 2007 IP
    andre75 likes this.
  7. andre75

    andre75 Peon

    Messages:
    1,203
    Likes Received:
    45
    Best Answers:
    0
    Trophy Points:
    0
    #7
    Found it:
    http://curl.phptrack.com/get_page.php?fuseaction=downloads

    Funny, that guy still runs the same offer he did when I bought the book half a year ago. Also his English may be a little funny at times and the book is thin, but the curl examples are really first rate and from there on you can do your own stuff, no problem.

    I think you get a zip file with the book and some php files (examples).

    Also this is not a book to learn PHP with. Its a book about curl and what to do with it. So if you are new to php (as I am) you might need a little more then this. This one however shows you how to log into a website, look around and do stuff. Without any prior knowledge and this book I had my CJ login script working quickly.
     
    andre75, May 2, 2007 IP
    ahkip likes this.
  8. pogung177

    pogung177 Well-Known Member

    Messages:
    415
    Likes Received:
    11
    Best Answers:
    0
    Trophy Points:
    110
    #8
    Currently, I still developing simple admin system to storing datafeeds from my merchants use CJ Webservice. Need few keyphrase to to generate niche produtcs. from the huge data on CJ server.
     
    pogung177, May 2, 2007 IP
  9. Boshy

    Boshy Peon

    Messages:
    22
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #9
    I think OpenAds do what u r looking for ...
    I sow it in the feature list but not tried it myself so dont rely on me
     
    Boshy, May 4, 2007 IP
  10. wwwbug

    wwwbug Peon

    Messages:
    296
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #10
    Go to cj and ask them for it , it will be more usefull
     
    wwwbug, May 4, 2007 IP
  11. andre75

    andre75 Peon

    Messages:
    1,203
    Likes Received:
    45
    Best Answers:
    0
    Trophy Points:
    0
    #11
    No, absolutely not. They created a datafeed for me and low and behold it had 5 advertisers in it. Completely useless for what I was going to do.
    I'd rather scrape the stuff I need.
     
    andre75, May 4, 2007 IP
  12. brandondrury

    brandondrury Peon

    Messages:
    375
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    0
    #12
    If some kids down the street created the CJ.com datafeed, I would say "Not bad! Your learning!".

    If a professional created the CJ.com datafeed, I can only hope that this human being doesn't have children.

    Brandon
     
    brandondrury, May 6, 2007 IP
  13. jazz7620

    jazz7620 Banned

    Messages:
    357
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    0
    #13
    You can always ask cj.com to create separate datafeed file for advertiser.
    I agree, the categorization of the products at times are very difficult to understand....but still better than nothing.
    I use the cj.com datafeed at couple of sites...Its one time parsing ... well...then there is file next week..so have to do again...

    So it has its own pros and cons.
     
    jazz7620, May 6, 2007 IP
  14. andre75

    andre75 Peon

    Messages:
    1,203
    Likes Received:
    45
    Best Answers:
    0
    Trophy Points:
    0
    #14
    I foolishly requested XML format before even writing a single line of code. Of course that made parsing the damn thing much more difficult.
    I wish they would have provided some samples to play with upfront.

    Then I get a 100MB file for 5 Advertisers. It would be nice to request whatever I need instead of having to download the entire thing.

    Well, and finally the name changes each time (date), which complicates automatic download.
     
    andre75, May 6, 2007 IP