Scrape first 1000 search queries URL

Discussion in 'Google' started by BigBadWolf, Apr 23, 2007.

  1. #1
    Is there anyway the quickly scrape the first 1000 results of a search query and export all the URLs?

    For example I would search "Digitalpoint" and all the 1000 URL results of that query would be exported? any software that does this?
     
    BigBadWolf, Apr 23, 2007 IP
  2. netmaster123

    netmaster123 Well-Known Member

    Messages:
    1,852
    Likes Received:
    47
    Best Answers:
    0
    Trophy Points:
    140
    #2
    netmaster123, Sep 26, 2007 IP
  3. story97

    story97 Peon

    Messages:
    181
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    0
    #3
    You should grab a freelance programmer. this would be an extremely easy thing to write in php using curl as long as G allows the connection and search. curl can grab the entire source of the page and using php you can strip it out however you want. It's also much lighter than you'd think.

    I can't imagine this would cost much at all.
     
    story97, Sep 26, 2007 IP
  4. netmaster123

    netmaster123 Well-Known Member

    Messages:
    1,852
    Likes Received:
    47
    Best Answers:
    0
    Trophy Points:
    140
    #4
    Thanks for the advice, I wanted to see if there is somebody here on dp that can do that.
     
    netmaster123, Sep 26, 2007 IP