I've posted a few threads asking how to use various Scrapers, Import from RSS Feeds etc, but now I want to know if it's possible to Scrape from a Couple of Sites. We need some Weather Information for our Site and want to scrape data from the following sites. http://www.metservice.com/marine/tides/kaikoura - The Whole Table http://www.metservice.com/marine/coastal/conway - The Forecast below the Map http://www.metservice.com/towns-cities/kaikoura - The Forecast http://www.metservice.com/national/maps-rain-radar/rain-radar-forecasts/rain-forecast-7-day - The Image is updated every 6 Hours http://swellmap.com/24hr_forecast.php?region=Christchurch&tag=Kahu&location=surfing#anchor - The Graph Any help would be MUCH APPRECIATED
RSS feeds are fair game (to a degree), but scraping is pushing it too far. That said... http://www.google.com/search?q=curl+scraping http://www.google.com/search?q=file_get_contents+scraping You're on your own with this one better get the PHP manual out
Good old Google! Thanks for that, it seems you help me with every question I have! (I'm not ignoring your help with the RSS feeds, I'm going to go with that - just wanted to check out the possibility of scraping from other sites) Will have to have a late night tonight looking over all this info Cheeers!
http://wonshik.com/snippet/Convert-HTML-Table-into-a-PHP-Array works to convert a table in html to an array. I've used it, you may have to fix a line or two depending on your html(you will get an error and adjust it) http://www.phpro.org/examples/Parse-HTML-With-PHP-And-DOM.html (he is doing almost the same thing as you want!) Also look into the Simple DOM library. It is the most POWERFUL web scraping tool I've ever used. http://simplehtmldom.sourceforge.net/ . I'm surprised its not added into PHP. I can make code to scrape almost any site in less than an hour with those tools. Some tasks need a bit more (regular expressions or string functions) but usually that is very minor. Last night I just finished one with an Ajax submit, but that is another story
Thanks for that, I like that phpro link, that could be quite helpful. Will give this all a go on the weekend as have pushed this part of project to the side to focus on the content a bit more.
I can make code as well for scraping anything you want from web.. if still looking for .. hit me up thanks
You PM'd me yesterday and I said that someone has offered to help me for free and you said to go with them?
Hi there, Our scraping service can fulfill your needs. Scraping.biz will harvest the accurate data and extract the complete results into logical categories from the broadest and deepest online resources. You can benefit from wide range of website categories including Businesses | Real Estates | Rentals | Classifieds | Jobs | Property | Social network | Automotive | Events | Lyrics | E-commerce | Books | Movie review | Domains | Search Engines | and more… Visit our website http://scraping.biz, Sign up SCRAPING service to get THOUSANDS of LEADS for FREE! For more information, please contact us via Skype: scrapingbiz_support Bests, Vicky