Me and a friend of mine are working on a website for a few months now for which we had to develop a crawler for it. It extracts a lot of useful information such as what are the most popular tags in a directory of blogs (such as myspace for instance) and which are the most linked blogs. It has no GUI yet.. just checking to see if there is a demand for such a thing.
It would be written in english. Basically thinking about letting it crawl a directory of blogs and extract certain tags, links.. their popularity. Things in that spirit.
Right, sorry, I meant what programming language? I'm working on developing a crawler / spider that searches for certain key words in a web page but would consider buying yours if it is done and works well.