Is it possible for me to scrape the whole of yell.co.uk ? I'm looking to collect Business Name, Phone Numbers, Address and email address. I have been using a google Web Scraper Add On for Chrome but I only seem to be able to scrape one area at a time and one industry. Also the search only brings back 10 pages maximum. This is my first post, sorry of this is the wrong place to post.
The links from the (yell.co.uk) national site point to the (yell.com) international site, thus, you should extract the data about the UK from the main site, which has more than 23 * 10^6 pages in the (google.com) now, thus, your amateurish actions will not bring the results, which you want. At the same time, anything, which is available for the human visitors, may be harvested by the robots. The question is, how much can you pay for this service.
There's probably a format they use for json feeds that can be picked up more easily than scraping. Have you looked at https://apify.com/mcdowell/yell-scraper/api There was a whole page of scrapers when I googled with