javascript scraping using user's IP address

Discussion in 'JavaScript' started by ErectADirectory, Aug 27, 2008.

  1. #1
    I too would like to scrape using the clients IP address instead of my server.

    so basically

    page loads javascript snippet
    browser scrapes a remote page using users IP
    browser then returns the results my php page for db archiving

    Sounds easy enough in PHP but can't do client side scripting with a server side language and I'm just too damn lazy to get up to speed with js.

    Any help appreciated!

    Also, bonus points will be awarded if you can make the scrape spoof or scrub the referrer.
     
    ErectADirectory, Aug 27, 2008 IP
  2. Pos1tron

    Pos1tron Peon

    Messages:
    95
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    0
    #2
    And this isn't paid because...? Honestly, people are generous, but not that generous...
     
    Pos1tron, Aug 27, 2008 IP
  3. ErectADirectory

    ErectADirectory Guest

    Messages:
    656
    Likes Received:
    65
    Best Answers:
    0
    Trophy Points:
    0
    #3
    If this were posted in the php section you'd get replies like

    But if you want to be a jerkoff and milk $10 out of someone for < 10 lines of code fire away, I'll pay for a working script.

    I truly would appreciate someone helping me out with this, I can trade PHP work or outright pay if someone can give me a solution.
     
    ErectADirectory, Aug 27, 2008 IP
  4. joebert

    joebert Well-Known Member

    Messages:
    2,150
    Likes Received:
    88
    Best Answers:
    0
    Trophy Points:
    145
    #4
    Cross-domain restrictions prevent what you're trying to do. the usual work around is actually sending a request to the originating server for PHP to make the actual request.
     
    joebert, Aug 29, 2008 IP
  5. ErectADirectory

    ErectADirectory Guest

    Messages:
    656
    Likes Received:
    65
    Best Answers:
    0
    Trophy Points:
    0
    #5
    I was afraid of that, if the request is coming from php then the server's ip address is used, which defeats the purpose. I'd just use a cron if I wanted it to originate from the server.

    Thanks for the response joebert
     
    ErectADirectory, Aug 30, 2008 IP
  6. ilook

    ilook Well-Known Member

    Messages:
    1,602
    Likes Received:
    15
    Best Answers:
    1
    Trophy Points:
    165
    #6
    why dont you use just php for it?
    you make it yourself difficult and its also a waste to use JS with it (what happens if i easily disable my JS).
    Javascript is client side, php server side.
    So just use a PHP script for that :)
    No javascript at all for this script.
     
    ilook, Aug 30, 2008 IP
  7. ErectADirectory

    ErectADirectory Guest

    Messages:
    656
    Likes Received:
    65
    Best Answers:
    0
    Trophy Points:
    0
    #7
    The title of the thread is "js scraping using user's IP address"

    Which means that if I do it server side, there will be limits imposed on my # of queries by the site I'm scraping.

    For this javascript is required so the script can run from a browser. There's no getting around this.

    Also if js is turned off or disabled, then that particular user won't do my scraping for me ... the other 85% of surfers will though :]
     
    ErectADirectory, Aug 30, 2008 IP
  8. ilook

    ilook Well-Known Member

    Messages:
    1,602
    Likes Received:
    15
    Best Answers:
    1
    Trophy Points:
    165
    #8
    I dont understand what you actually mean then....sorry:(
     
    ilook, Aug 30, 2008 IP