Hello I am looking for a web crawler. I have no experience in this area and need your help, please. The crawler will be used to track online infringements. The plan is to also integrate it with a case management system. The requirements that I have are: - specify start and end point of the crawl - end point of the crawl may be defined after the crawl has been initiated - regular monitoring of pre-programmed sites - allow additional sites to be added on ad-hoc basis - results matched to pre determined patterns both automatically and manually I am pretty much open to opensource or non-opensource crawlers, trying to find the best possible options available. Highly appreciate your help! Thanks
Try to buy google bot Takes days to install but its working for 100% right now at http://www.bpled.com
bpled your tool is rubbish. it is just a way for you to make money via google adsense search. google dark will won't make you save any money. will just make bpled more money !