using internet as a database?

Discussion in 'Content Management' started by wordlinkz, Feb 14, 2009.

  1. #1
    Hello,

    Is there any working model sites where anyone can make a web crawler go according to their need , where we can use the internet as a database and build necessary applications.
     
    wordlinkz, Feb 14, 2009 IP
  2. Tom Thumb

    Tom Thumb Notable Member

    Messages:
    1,529
    Likes Received:
    55
    Best Answers:
    0
    Trophy Points:
    215
    #2
    Sphider is the only open source spider ive used...
    not sure if thats what you are after..?

    You can have it follow links on any site....
     
    Tom Thumb, Feb 17, 2009 IP