I too would like to scrape using the clients IP address instead of my server. so basically page loads javascript snippet browser scrapes a remote page using users IP browser then returns the results my php page for db archiving Sounds easy enough in PHP but can't do client side scripting with a server side language and I'm just too damn lazy to get up to speed with js. Any help appreciated! Also, bonus points will be awarded if you can make the scrape spoof or scrub the referrer.
If this were posted in the php section you'd get replies like But if you want to be a jerkoff and milk $10 out of someone for < 10 lines of code fire away, I'll pay for a working script. I truly would appreciate someone helping me out with this, I can trade PHP work or outright pay if someone can give me a solution.
Cross-domain restrictions prevent what you're trying to do. the usual work around is actually sending a request to the originating server for PHP to make the actual request.
I was afraid of that, if the request is coming from php then the server's ip address is used, which defeats the purpose. I'd just use a cron if I wanted it to originate from the server. Thanks for the response joebert
why dont you use just php for it? you make it yourself difficult and its also a waste to use JS with it (what happens if i easily disable my JS). Javascript is client side, php server side. So just use a PHP script for that No javascript at all for this script.
The title of the thread is "js scraping using user's IP address" Which means that if I do it server side, there will be limits imposed on my # of queries by the site I'm scraping. For this javascript is required so the script can run from a browser. There's no getting around this. Also if js is turned off or disabled, then that particular user won't do my scraping for me ... the other 85% of surfers will though :]