My own search engine

Discussion in 'All Other Search Engines' started by wizcom, Jun 3, 2009.

  1. christyzen

    christyzen Peon

    Messages:
    647
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #41
    Think, it will be tough task, but keep on trying, it will be one day.
     
    christyzen, Nov 23, 2009 IP
  2. barrywiki

    barrywiki Peon

    Messages:
    154
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #42
    LMAO. Why not 'yahoo' about it, then!?

    Visit Hotscripts and (yes) search for search engine and I'm sure there will be lots of options displayed.

    Don't listen to all the nay-sayers. OK, it is relatively unlikely that you will trouble Google and knock their business, but, you know, the net isn't all or nothing. You could have a good, liveable income from a search engine site which is tiny compared to Google, especially if it caters for a strong;y supported niche. Go for it! And if you incorporate PPC and need an xml ad feed to get you started, give me a shout
     
    Last edited: Nov 29, 2009
    barrywiki, Nov 29, 2009 IP
  3. Dismatikz

    Dismatikz Well-Known Member

    Messages:
    698
    Likes Received:
    5
    Best Answers:
    0
    Trophy Points:
    110
    #43
    It's that kind of thinking that sets apart the Zero's, from the Hero's.
     
    Dismatikz, Nov 30, 2009 IP
  4. SonnyCooL

    SonnyCooL Peon

    Messages:
    1,170
    Likes Received:
    13
    Best Answers:
    0
    Trophy Points:
    0
    #44
    I doing one property classifieds SE for my country and it ain't easy as i though :)


    u can have test run here, condo.com.my (all abt property classifieds search).
    Best view with FF or IE8 (for the moment)
     
    SonnyCooL, Dec 1, 2009 IP
  5. eauncarter

    eauncarter Active Member

    Messages:
    441
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    75
    #45
    Wow man quite a nice job...how much time did it take you to make that :confused:
     
    eauncarter, Dec 1, 2009 IP
  6. sbyholm

    sbyholm Peon

    Messages:
    30
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #46
    I just got an email from isedn.org and it seems they also have a search api so you can make a private label search engine using their index. This could be an option for any of you considering making a SE.

    This is the jayde online/exactseek network that sells those "fixed price ads $4 per month for any keyword" that you probably have seen advertisied everywhere on the net. I'm considering joining the network with my search engine to get some more exposure and a way to monetize it, lets see how it turns out.
     
    sbyholm, Dec 5, 2009 IP
  7. shofstetter

    shofstetter Well-Known Member

    Messages:
    178
    Likes Received:
    7
    Best Answers:
    1
    Trophy Points:
    120
    #47
    check out www.openwebspider.org it would be a good place to start even if you don't use their code it will give you a good idea of how to make your own spider.
     
    shofstetter, Dec 6, 2009 IP
  8. remember123

    remember123 Peon

    Messages:
    620
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    0
    #48
    you have to have your own spider for crawling the content and it requires you to have high end servers and a custom script..
     
    remember123, Dec 6, 2009 IP
  9. psychost

    psychost Active Member

    Messages:
    419
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    65
    #49
    A few years ago gigablast would allow you to take a small bit of html and you could really customize it for your own engine, completely transparent, aside from the url you'd never know it was gigablast and with a cname record you could even cover up that.
     
    psychost, Dec 6, 2009 IP
  10. sbyholm

    sbyholm Peon

    Messages:
    30
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #50
    Any idea how many pages open web spider can index, i.e. the max index size? I didn't find that information on the site.

    Simon
     
    sbyholm, Dec 6, 2009 IP
  11. taminder

    taminder Peon

    Messages:
    581
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #51
    you have 2 solutions now:
    1) use Google CSE to make a refined soccer search engine (you can remove the advertisements for $100/year).
    2) create your own search engine where you manually submit the websites you want to crawl.

    let me know which of these 2 options you would like to do and I'll help you out on both of them.
     
    taminder, Dec 6, 2009 IP
  12. saroj123

    saroj123 Peon

    Messages:
    103
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #52
    as far as there are google and yahoo no one can beat them.
     
    saroj123, Dec 12, 2009 IP
  13. sbyholm

    sbyholm Peon

    Messages:
    30
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #53
    I just found out about a Swedish search engine Entireweb. Seem they have been operating since the year 2000 and has an index of over 100 million international webpages.

    Best thing is they give you an xml datafeed of the search results free here:

    http://www.entireweb.com/services/xml/

    Simon
     
    sbyholm, Dec 12, 2009 IP
  14. rishabhverma

    rishabhverma Peon

    Messages:
    22
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #54
    Thats a great idea, but mind it you will need a team to do it, and this is a list of open source crawlers in Java which might help you.
     
    rishabhverma, Dec 12, 2009 IP
  15. sbyholm

    sbyholm Peon

    Messages:
    30
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #55
    You forgot to give us the list

    Simon
     
    sbyholm, Dec 12, 2009 IP
  16. imurzz

    imurzz Peon

    Messages:
    44
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #56
    imurzz, Dec 12, 2009 IP
  17. sbyholm

    sbyholm Peon

    Messages:
    30
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #57
    Not a bad idea if you could get rid of the frames and combine the results in a useful way, maybe one listing for Bing+Google and then a separate feed for twitter updates

    Simon
     
    sbyholm, Dec 12, 2009 IP
  18. peepin2me

    peepin2me Well-Known Member

    Messages:
    2,097
    Likes Received:
    66
    Best Answers:
    0
    Trophy Points:
    115
    #58
    Nice Idea. If only wishes were horses...
     
    peepin2me, Dec 12, 2009 IP
  19. searchia

    searchia Well-Known Member

    Messages:
    1,179
    Likes Received:
    16
    Best Answers:
    0
    Trophy Points:
    115
  20. tattoos

    tattoos Prominent Member

    Messages:
    1,903
    Likes Received:
    150
    Best Answers:
    0
    Trophy Points:
    335
    #60
    Creating a search engine from scratch sounds like a bit of a major, but if you like doing that sort of thing, go for it. "sbyholm" seems to have done a pretty good job.

    If you were just after a simple one, then I would also suggest Google CSE, its easy to configure and works well.
    If you have an AdSense account, you can set one up using AdSense for search (AFS), once it starts getting a lot of use, you can start making money from it.
    I don't know if the AFS have any query limits... I have quite a few set up, combined queries are between 70k and 80k a day.
    Although it only makes a few dollars, its better than costing me a few dollars a day ;)

    Cheers
    James

    Cheers
    James
     
    tattoos, Dec 12, 2009 IP