Working on a crawler... would this be helpful for you guys?

Discussion in 'Search Engine Optimization' started by Prookle, Sep 20, 2006.

  1. #1
    Hi,
    Like a lot of people know, search engine crawlers does not crawl very deep into some kind of sites, like forums, and also do not detect dynamic linking.

    Im currently finishing a crawler project. The crawler simply crawl websites and check them for links to other sites. It crawls ANY type of http urls, even the dynamic links.

    The purpose of this crawler would be to know where other webmasters of the same niche as you do their marketting.

    I would like to know, does anyone would be interested in such informations? I did this project as a university project, and I just finished it after 2 years.

    I would just need to create a website to show the data and buy some servers to make the crawler crawl.

    So, Im asking again, is anyone interested in such informations? If yes, Ill create the website and launch the crawlers. The website would be free to use.

    Thanks all for your suggestions and opinions,
    Steve
     
    Prookle, Sep 20, 2006 IP
  2. AfterHim.com

    AfterHim.com Peon

    Messages:
    1,923
    Likes Received:
    51
    Best Answers:
    0
    Trophy Points:
    0
    #2
    I would use it.

    Brandon
     
    AfterHim.com, Sep 20, 2006 IP