I am working on a service which will enable directory owners to help clean and maintain their directories. I have the basic solution ready and am inviting testers on a private beta basis. At the moment the solution is a very simple and would flag various unaccepted sites on your directories. The service currently detects Deadlinks -> checked numerous times over a period of time before flagging Parked Domain -> domains which were normal when submitted but now parked future checks will include Adult sites Gambling sites MFA sites Splogs This service will only be for directory owners, i am planning to provide this service initially as free for private beta testers. I am wondering if there you would be intrested in such a service. If so please send me an email on with the following: subject -linkhunting name - email - dpusername- directoryurl- please note that at the moment only one directory per user will be allowed. I shall be sending the invitation emails end of this week. 40 Spots are open for the first private beta.Please post here that you sent me an email so i can work out First come basis.
Do you need to crawl the directory in question for links, or will a text file full of urls be preferable? Also, is it a service that crawls the first page of any submitted link, or does it go any deeper?
it crawls the directory to get the links so you dont need to provide text file of urls. I currently only crawls the first page of the link but another function to be added is crawling multiple pages of external sites.