Hello dear DP members. I am looking for programmer who is able to create a crawler that will crawl few websites with classifieds and extract data (several attributes or specifications of entities) and input them into my database. Along with crawler I would also like to have search on my website for that data from my database. Where users will be able to search my database for classifieds by their specific attributes (basic and advanced search with filters). Crawler should also have an option to set the period of crawling repetition. If you can do this please reply or send PM for further details. Thank you very much.
Hello dear Dis is Souvik I want to do ur project I have 3 Yr+ experince in php Coding Add me in MSN/Yahoo to hire me .. Regards Souvik
I have already created a script like this. If your interested in it, send me a PM (It's currently set to crawl the entire web, but can be modified to meet your needs)
I have already created a script like this in ASP Vbscript. I used both Ms Access and MySQL Database. mostly I have extracted news with category and and saved in database with category/title/keywords/desc/text content/picture/date/time/robot notes/category notes/and many others. it just works like person and auto updates. then I have added some SEO function for the script. also I am thinking in future I will write code for crawling from vBulletin and webwiz forums. if you want, I can do this job if you pay well. you can PM me the details.
Just to know, basically what would be the budget to do this kind of project? I might need this kind of crawler in the future, thats y i am asking.