How to Scrape Overture Bid Prices? Need Help

Discussion in 'PHP' started by ilove_amazon_unbox, Sep 15, 2006.

  1. #1
    Hi - I want to scrape overture bid prices from the overture bid tool using PHP. It has a capcha and I don't know how to defeat it. I know php and curl. I have been trying to figure it out for an entire day. I need some help. Can someone post code?
     
    ilove_amazon_unbox, Sep 15, 2006 IP
  2. vdd

    vdd Peon

    Messages:
    34
    Likes Received:
    5
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Try to use GD2 library and build original algo to recognize a captcha. But it'll be difficult.
     
    vdd, Sep 15, 2006 IP
  3. ilove_amazon_unbox

    ilove_amazon_unbox Peon

    Messages:
    2
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    I have been trying to use CURL and PHP.

    Is there a way to semi automate it? Ask for a human to enter the capcha once? How do I get it so that the PHP remembers the fact that I entered the correct capcha once?
     
    ilove_amazon_unbox, Sep 15, 2006 IP
  4. vdd

    vdd Peon

    Messages:
    34
    Likes Received:
    5
    Best Answers:
    0
    Trophy Points:
    0
    #4
    One query -- one captcha. It's easy to semi automate the process. But one captcha per query.
     
    vdd, Sep 15, 2006 IP
  5. wormser

    wormser Well-Known Member

    Messages:
    112
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    138
    #5
    How would you semi automate? That's what I've been tring to do, I just want to have the regular overture bid tool, but on my site so I can can put the results in my database.
     
    wormser, Sep 28, 2006 IP
  6. ccoonen

    ccoonen Well-Known Member

    Messages:
    1,606
    Likes Received:
    71
    Best Answers:
    0
    Trophy Points:
    160
    #6
    i thought the overture tool sets sessions on captcha completion. Capture the cookie it "tried" to send to you, and store it in a cookie collection. Then pass that back to the overture bidding tool when it requests it. Then you only have to do it once.
     
    ccoonen, Sep 28, 2006 IP