looking for free search engine

Discussion in 'Programming' started by schlogo, May 24, 2007.

  1. #1
    Hello

    I have a website using google coop but I am tired of it, i d like my own spider, any free script doing that?
     
    schlogo, May 24, 2007 IP
  2. nico_swd

    nico_swd Prominent Member

    Messages:
    4,153
    Likes Received:
    344
    Best Answers:
    18
    Trophy Points:
    375
    #2
    Your own spider? And you want to store thousands of sites on your server and plan to have an algorithm which allows you to search through these cached sites within seconds? You need thousands of servers, and unlimited spiders which browse the net continuously and update your database. This is way more complex than you probably image. It's easier to stay with Google, if you ask me.
     
    nico_swd, May 25, 2007 IP
  3. stickycarrots

    stickycarrots Peon

    Messages:
    4,513
    Likes Received:
    115
    Best Answers:
    0
    Trophy Points:
    0
    #3
    I have a pretty nice script I can hook you up with. I've built quite a few custom search engines.

    PM me and maybe we can work something out... :)
     
    stickycarrots, May 25, 2007 IP
  4. turbosatan

    turbosatan Well-Known Member

    Messages:
    957
    Likes Received:
    24
    Best Answers:
    0
    Trophy Points:
    135
    #4
    there is no way you are gonna do it better than google

    combine that search power with yahoo and other major engines and you should show up any results you will ever need
     
    turbosatan, May 25, 2007 IP
  5. schlogo

    schlogo Well-Known Member

    Messages:
    1,615
    Likes Received:
    26
    Best Answers:
    0
    Trophy Points:
    140
    #5
    I want to spider only certain sites like google coop does but it s limited to 100 sites , I might have 500, If you know solutions, i am ok :D
     
    schlogo, May 25, 2007 IP
  6. atmsky

    atmsky Peon

    Messages:
    28
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #6
    Trust youself ,you will succeed~

    I have some codes,ICQ me~~
     
    atmsky, May 25, 2007 IP
  7. mmurtha

    mmurtha Peon

    Messages:
    397
    Likes Received:
    48
    Best Answers:
    0
    Trophy Points:
    0
    #7
    schlogo,

    There are scripts out there that all you to do what you want without having a ton of server power. I hate to disagree with some of the others, but I do know you can get spidering scripts. I use 3 different types of search engine scripts and spiders, and I only use them on a VPS account.

    In saying this, the scripts I use are far from being free though. Sorry buddy...
     
    mmurtha, May 26, 2007 IP
  8. chrisfr

    chrisfr Peon

    Messages:
    94
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #8
    The best opensource solution to manage your own search engine is aspseek.
     
    chrisfr, May 27, 2007 IP
  9. 0n3Liner

    0n3Liner Peon

    Messages:
    36
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #9
    did you try checking out hotscripts?
     
    0n3Liner, May 27, 2007 IP
  10. schlogo

    schlogo Well-Known Member

    Messages:
    1,615
    Likes Received:
    26
    Best Answers:
    0
    Trophy Points:
    140
    #10
    hello

    I looked at hotscript but nothing really titilating there. aspeek looks like a good solution, It will require some testing but it seems to be ok
     
    schlogo, May 28, 2007 IP
  11. tylerd

    tylerd Peon

    Messages:
    7
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #11
    Do a search for Nutch
     
    tylerd, May 29, 2007 IP
  12. painthappy

    painthappy Peon

    Messages:
    93
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    0
    #12
    Datapark Search Engine

    http://www.dataparksearch.org/

    I've actually used it. Works real well, and fairly customizable. The instructions are not the best, but once you learn how to use it, you can do a lot with it.
     
    painthappy, May 29, 2007 IP
  13. vegabond

    vegabond Shabu Anower

    Messages:
    1,656
    Likes Received:
    289
    Best Answers:
    0
    Trophy Points:
    240
  14. ErectADirectory

    ErectADirectory Guest

    Messages:
    656
    Likes Received:
    65
    Best Answers:
    0
    Trophy Points:
    0
    #14
    All this and not a mention of sphider

    Quick, simple, easy to install and customize all wrapped up in a LAMP (linux, apache, mysql, php) friendly package. Ooh, yea and it's totally free and open source.

    Do yourself a favor and check it out. I've used on many occasions, however, this is not meant for a full scale engine like google. But it will work perfectly fine for ~ 500 sites.

    Google coop sucks because it is all javascript just like their search API. Talk about a paranoid company ....
     
    ErectADirectory, May 29, 2007 IP
  15. schlogo

    schlogo Well-Known Member

    Messages:
    1,615
    Likes Received:
    26
    Best Answers:
    0
    Trophy Points:
    140
    #15
    I ll check all your links, I do agree about google coop, it s*cks ...
     
    schlogo, May 30, 2007 IP
  16. freakitude

    freakitude Banned

    Messages:
    324
    Likes Received:
    24
    Best Answers:
    0
    Trophy Points:
    0
    #16
    Sphider - a php spider and search engine

    cs.ioc.ee/~ando/sphider/
     
    freakitude, Jun 5, 2007 IP