Shawn, what's been your solution with VB4 search and DP?

Discussion in 'vBulletin' started by sungek, Mar 8, 2010.

  1. #1
    I noticed search on DP with VB4 isn't all too bad. I run a forum that's very much smaller but still search kills everything since upgrading. Were you able to get a sphinx working?
     
    sungek, Mar 8, 2010 IP
  2. digitalpoint

    digitalpoint Overlord of no one Staff

    Messages:
    38,334
    Likes Received:
    2,613
    Best Answers:
    462
    Trophy Points:
    710
    Digital Goods:
    29
    #2
    No, we aren't (yet) using a Sphinx based search, but will be soon.
     
    digitalpoint, Mar 8, 2010 IP
  3. Woodcs82

    Woodcs82 Well-Known Member

    Messages:
    2,588
    Likes Received:
    32
    Best Answers:
    0
    Trophy Points:
    150
    #3
    Excuse me for my ignorance, but what is Sphinx?

    Also, Shawn - (Join Date,Location,Posts, and Phone verified are all showing up on the Join Date line)

    -C
     
    Woodcs82, Mar 8, 2010 IP
  4. infogle

    infogle Prominent Member

    Messages:
    2,732
    Likes Received:
    128
    Best Answers:
    1
    Trophy Points:
    300
    #4
    Yes... in IE it is seeing like that... with not proper alignment of things... shawn - if you are reading... please correct the look and feel of the site in IE also

    Hope it helps...
     
    infogle, Mar 8, 2010 IP
  5. digitalpoint

    digitalpoint Overlord of no one Staff

    Messages:
    38,334
    Likes Received:
    2,613
    Best Answers:
    462
    Trophy Points:
    710
    Digital Goods:
    29
    #5
    Sphinx is an insanely fast search engine.

    http://www.sphinxsearch.com/

    Queries that might take a few minutes to run with the vBulletin search, take ~0.1 seconds (really).

    I'm working on building a seamless Sphinx integration for vB4, but it's not done yet.

    Yeah... IE isn't really at the top of the priority list to be honest. If stuff works properly with Firefox, Safari, Chrome and Opera, I'm not really going to sit down and make a custom version of something just so it works with IE. It should already work, and if Microsoft is too lazy to make a browser work like every other browser, I'm not going to waste my time redeveloping everything for IE. Ultimately the problem is with IE/Microsoft, and making new versions of stuff to patch it's bugs isn't something I'm going to spend much time on.
     
    digitalpoint, Mar 8, 2010 IP
  6. Woodcs82

    Woodcs82 Well-Known Member

    Messages:
    2,588
    Likes Received:
    32
    Best Answers:
    0
    Trophy Points:
    150
    #6
    Thanks!

    I'll def. be doing that....right now im waiting to upgrade....what version are you on now?

    Us lazy folks should really upgrade our browsers :cool: jk
     
    Woodcs82, Mar 8, 2010 IP
  7. digitalpoint

    digitalpoint Overlord of no one Staff

    Messages:
    38,334
    Likes Received:
    2,613
    Best Answers:
    462
    Trophy Points:
    710
    Digital Goods:
    29
    #7
    On vBulletin 4.0.2.
     
    digitalpoint, Mar 8, 2010 IP
  8. sungek

    sungek Peon

    Messages:
    2
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #8
    Can you give any insight as to how far along you've gotten it and whether you plan to make it available for others to download and integrate as well?

    If you need beta testers, let me know :)
     
    sungek, Mar 9, 2010 IP
  9. digitalpoint

    digitalpoint Overlord of no one Staff

    Messages:
    38,334
    Likes Received:
    2,613
    Best Answers:
    462
    Trophy Points:
    710
    Digital Goods:
    29
    #9
    It's currently indexing everything, but I haven't had time to work on the front-end side of things (the actually searching of those indexes) yet. It's not going to be publicly available.
     
    digitalpoint, Mar 9, 2010 IP
  10. Woodcs82

    Woodcs82 Well-Known Member

    Messages:
    2,588
    Likes Received:
    32
    Best Answers:
    0
    Trophy Points:
    150
    #10
    Thanks... im having a really hard time getting a hold of them lately

     
    Woodcs82, Mar 10, 2010 IP
  11. digitalpoint

    digitalpoint Overlord of no one Staff

    Messages:
    38,334
    Likes Received:
    2,613
    Best Answers:
    462
    Trophy Points:
    710
    Digital Goods:
    29
    #11
    As an update... I've rolled out the Sphinx search here, so it's running/indexing everything in parallel with the default search system and I have a way to toggle between the two so I can go through and test everything... Things that are seem to be working so far:

    • Indexing... internally managing a delta index that is updated with all changes every 5 minutes.
    • Quick search (the box in the upper right of all pages)
    • Advanced search for posts, blog entries, blog comments, forums, threads, visitor messages
    • Tag searching (for posts and blog entries)
    • Searching for all (or some) posts made by a user
    • Searching for all (or some) threads made by a user
    • Searching just specific forums (and/or sub-forums)
    • Date ranges (for example show posts just from the last week)
    • Sorting works based on relevance, post/thread start date, last post date, number of replies

    Stuff that I know about that doesn't yet work...

    • Advanced search for social groups and social group messages
    • Searching for threads based on number of replies or prefix

    Stuff that I know doesn't work (and won't work when it's done)...

    • Ability to sort results by strings (thread title or username)
    • Ability to sort threads in results by number of views

    The nice thing about it all is that it's blazingly fast... you can run the most complex queries imaginable and it takes a fraction of a second. It also does not need to hit your MySQL databases when running queries so it offloads a ton of overhead from your DB servers. The Sphinx search engine uses pretty much no resources.
     
    digitalpoint, Mar 23, 2010 IP
  12. Woodcs82

    Woodcs82 Well-Known Member

    Messages:
    2,588
    Likes Received:
    32
    Best Answers:
    0
    Trophy Points:
    150
    #12
    Sweet!!! Sphinx is here! .....Took a bit but its worth it!
     
    Woodcs82, Mar 24, 2010 IP
  13. digitalpoint

    digitalpoint Overlord of no one Staff

    Messages:
    38,334
    Likes Received:
    2,613
    Best Answers:
    462
    Trophy Points:
    710
    Digital Goods:
    29
    #13
    It's actually live now for everyone btw... although I haven't officially announced it because still working on a few minor things. But if you do a search, it should be much faster... even if you do idiotic searches (like 10 keywords that exist in millions of posts).
     
    digitalpoint, Mar 24, 2010 IP
  14. digitalpoint

    digitalpoint Overlord of no one Staff

    Messages:
    38,334
    Likes Received:
    2,613
    Best Answers:
    462
    Trophy Points:
    710
    Digital Goods:
    29
    #14
    BTW... Searching for threads based on number of replies and/or prefixes works properly now.
     
    digitalpoint, Mar 24, 2010 IP
  15. joeychgo

    joeychgo Notable Member

    Messages:
    3,368
    Likes Received:
    321
    Best Answers:
    0
    Trophy Points:
    255
    #15
    Nicely done Shawn
     
    joeychgo, Mar 25, 2010 IP
  16. RectangleMan

    RectangleMan Notable Member

    Messages:
    2,825
    Likes Received:
    132
    Best Answers:
    0
    Trophy Points:
    210
    #16
    FYI Shawn I switched to Sphinx this week for my 3 million post forum running MyBB. MyBB developer already wrote a very good plugin for it. Took me less than an hour to install Sphinx and configure everything. Server load diminished greatly. I was on the verge of needing a 4th server and Sphinx saved me. I'm thinking I can squeeze 5 million posts now out my current hardware but hard to tell just yet.

    Sphinx is da bomb. That's all I'm saying.
     
    RectangleMan, Mar 25, 2010 IP
  17. digitalpoint

    digitalpoint Overlord of no one Staff

    Messages:
    38,334
    Likes Received:
    2,613
    Best Answers:
    462
    Trophy Points:
    710
    Digital Goods:
    29
    #17
    Yep... Sphinx is super sick and uses a ridiculously low amount of resources. The current machine I have running Sphinx is my dev machine and it's mostly running idle...

    I'm probably going to move Sphinx to my web server machines and just run it there.
     
    digitalpoint, Mar 25, 2010 IP
  18. RectangleMan

    RectangleMan Notable Member

    Messages:
    2,825
    Likes Received:
    132
    Best Answers:
    0
    Trophy Points:
    210
    #18
    Yeah I don't understand how it's so efficient.
     
    RectangleMan, Mar 25, 2010 IP