1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Search Engine Script??

Discussion in 'Programming' started by ozband, Sep 13, 2005.

  1. #1
    Hi,

    Im looking to start a nice little search engine and Im wondering what scripts you guys know of which would be suitable. It would need to have a crawler and automatically index pages???
    SEMrush
    Thanks all...
     
    ozband, Sep 13, 2005 IP
    SEMrush
  2. iTISTIC

    iTISTIC Peon

    Messages:
    140
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    0
    #2
    You need more than scripts. A spider (or crawler) is a stand-alone program that you would have to create.

    I also highly doubt you'll find any "scripts" out there for the taking that provide very good search capability.

    Also keep in mind you'll need some sort of data store for the spidered sites.

    If you PM me more of what you have in mind I'll be able to help guide you further. Just to break it to you now -- this is not something you can download a few scripts for, throw them on your web site, and be done with them. This is a large project that could take quite a long time to develop properly.
     
    iTISTIC, Sep 13, 2005 IP
  3. digitalpoint

    digitalpoint Overlord of no one Staff

    Messages:
    38,297
    Likes Received:
    2,602
    Best Answers:
    461
    Trophy Points:
    710
    Digital Goods:
    29
    #3
    digitalpoint, Sep 13, 2005 IP
  4. rederick

    rederick Peon

    Messages:
    128
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #4
    rederick, Sep 13, 2005 IP
  5. ozband

    ozband Active Member

    Messages:
    408
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    78
    #5
    looks rather good that. But im looking to get a bit more serious.

    What do I need to install verities ultraseek??? I assume its not just a case of find some hosting and upload the files. I think you need to have your own server, which i would love to know more about.

    Anyhow, check out http://downloadcenter.verity.com/dlc/index.jsp

    Would love to know more about it. :)
     
    ozband, Sep 17, 2005 IP
  6. johnt

    johnt Peon

    Messages:
    178
    Likes Received:
    21
    Best Answers:
    0
    Trophy Points:
    0
    #6
    There's a list of some open source search tools here. I've used Nutch before to provide site-search capabilities and its not too bad, though you may need to tinker with the weightings it applies to things like titles, descriptions, links etc.

    cheers

    John
     
    johnt, Sep 18, 2005 IP
  7. ozband

    ozband Active Member

    Messages:
    408
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    78
    #7
    Thanks john.. :)
     
    ozband, Sep 18, 2005 IP
  8. michele

    michele Peon

    Messages:
    30
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #8
    Nutch seems like the most serious open source contender:

    lucene.apache.org

    It is an Apache project so it is probably a high quality product with good support.

    They talk about it scaling up well, which is something that simpler Perl script-type systems probably won't do.
     
    michele, Sep 20, 2005 IP