Considering all the programmers I work with are busy as hell, and I don't really want to dip into craigslist, I figured I would toss it out here. I need a crawler program. The gist of it: I want to dump a bulk load of urls (1k+ at a time) into a program. A bot would crawl the source code looking for a specific snippet of code/phrase. The end result would be a sorted list of urls that contain that snippet of code/phrase in the source code, and one without. I don't do programming/web dev, so I hope you get the explanation. If you can help out, let me know. Money is an object. Thanks in advance guys!
I agree.. Perl could do this job with ease.. PM me.. I'll do that for FREE.. in return for... but be quick, my free time won't last forever...