I need a server to be able to handle 1000 requests per second

Discussion in 'Web Hosting' started by ASTRAPI, Oct 27, 2009.

  1. #1
    Hello

    I need a server to ba able to handle more than 1.000 sql requests per second for my invision forum.

    My current server Dual Xeon 4gb ram and 100 port seems not able to handle that traffic.

    I think the 100 port and maybe cpu can't handle so many requests.

    So please give me your options to solve 100% my problem with better ports or maybe cloud or....

    What you thing that reayly helps?

    My budget is about 120euro / 180 $ :)

    Thank you
     
    ASTRAPI, Oct 27, 2009 IP
  2. vindointernational

    vindointernational Greenhorn

    Messages:
    58
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    18
    As Seller:
    100% - 0
    As Buyer:
    0.0% - 0
    #2
    well, you can get 3 low cost servers , like OVH.COM and run a MySQL LoadBalancer with 1 "writer" server and 2 or 3 "readers" servers.

    are your runnning webserver in the same machine ?

    Rgds.
     
    vindointernational, Oct 27, 2009 IP
  3. theapparatus

    theapparatus Peon

    Messages:
    2,925
    Likes Received:
    119
    Best Answers:
    0
    Trophy Points:
    0
    As Seller:
    100% - 0
    As Buyer:
    100% - 0
    #3
    Just to clarify, do you mean 100 simultaneous connections?

    Are you running any sort of caching, either file or memcache, between the forum and the database? With 4 gigs of memory and what I assume to be complete control over the server, you should be able to get it in there. What steps have you taken to help reduce load?
     
    theapparatus, Oct 27, 2009 IP
  4. g-Vector

    g-Vector Well-Known Member

    Messages:
    221
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    130
    As Seller:
    100% - 0
    As Buyer:
    100% - 0
    #4
    You could try to tune your MySQL installation first.
    There is a script project named "MySQL Tuning Primer" linked from the official MySQL website.
    After analysis, the script makes recommendations for tuning your MySQL server/installation.
    If you are not able to apply the recommendations yourself, ask your host to make a backup first, and then make the modifications.
    http://forge.mysql.com/projects/project.php?id=44
    Code (markup):
    The newest version is always available from the script authors website :
    http://www.day32.com/MySQL/
    Code (markup):
    If you decide to take this route, good luck with it.
     
    g-Vector, Oct 28, 2009 IP
  5. kabayan2009

    kabayan2009 Well-Known Member

    Messages:
    135
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    100
    As Seller:
    100% - 0
    As Buyer:
    100% - 1
    #5
    also consider getting SAS drives they are really fast compared to regular SATA drive!
     
    kabayan2009, Oct 28, 2009 IP
  6. iBoot

    iBoot Well-Known Member

    Messages:
    1,596
    Likes Received:
    25
    Best Answers:
    0
    Trophy Points:
    165
    As Seller:
    100% - 0
    As Buyer:
    100% - 0
    #6
    yap he also need 4gb+ ram
     
    iBoot, Oct 28, 2009 IP
  7. ASTRAPI

    ASTRAPI Guest

    Messages:
    500
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    As Seller:
    100% - 0
    As Buyer:
    100% - 0
    #7
    Hello

    I run all of them in one server and i mean 1.000 requests to the sql about per second or two.

    Yes i use memcache and i tune sql also.
     
    ASTRAPI, Oct 28, 2009 IP
  8. g-Vector

    g-Vector Well-Known Member

    Messages:
    221
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    130
    As Seller:
    100% - 0
    As Buyer:
    100% - 0
    #8
    Then run MySQL on its own server.
     
    g-Vector, Oct 28, 2009 IP
  9. theapparatus

    theapparatus Peon

    Messages:
    2,925
    Likes Received:
    119
    Best Answers:
    0
    Trophy Points:
    0
    As Seller:
    100% - 0
    As Buyer:
    100% - 0
    #9
    Not with an $180 a month budget. Considering the poster already has a Dual Xeon 4gig, I have a feeling most of that budget is being taken by that.

    In all honesty, I'd be asking on the invision forums for help as that's where the experts are going to be for this.
     
    theapparatus, Oct 28, 2009 IP
  10. g-Vector

    g-Vector Well-Known Member

    Messages:
    221
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    130
    As Seller:
    100% - 0
    As Buyer:
    100% - 0
    #10
    Yeah, otherwise he is lost forever.
    You need professional help ASTRAPI. :p
    (Just kidding.)
     
    g-Vector, Oct 28, 2009 IP
  11. LH-Danny

    LH-Danny Member

    Messages:
    398
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    35
    As Seller:
    100% - 0
    As Buyer:
    100% - 0
    #11
    I agree, professional help is the only way you're going to reduce the server load on this.

    Give me a buzz if you need any help, I'm willing.
     
    LH-Danny, Oct 28, 2009 IP
  12. aassociatehit

    aassociatehit Well-Known Member

    Messages:
    1,778
    Likes Received:
    23
    Best Answers:
    0
    Trophy Points:
    140
    As Seller:
    100% - 0
    As Buyer:
    100% - 0
    #12
    I work with many clients who always has high traffic, so we mostly sell high confi server, which can easily handle such connection.

    It will be difficult though to get such server in your budget, if you need any help, do contact me
     
    aassociatehit, Oct 28, 2009 IP
  13. Mia

    Mia R.I.P. STEVE JOBS

    Messages:
    23,694
    Likes Received:
    1,167
    Best Answers:
    0
    Trophy Points:
    440
    As Seller:
    100% - 0
    As Buyer:
    100% - 0
    #13
    What are the specs on your current CPU??? Thanks.
     
    Mia, Oct 28, 2009 IP
  14. g-Vector

    g-Vector Well-Known Member

    Messages:
    221
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    130
    As Seller:
    100% - 0
    As Buyer:
    100% - 0
    #14
    OK, it seems that the professional help I was NOT kidding about has found their way to you.
    (They don't sound like psychiatrists, and will probably save you from needing one if your MySQL keeps choking.)

    Good luck and post back what resolution fixed your MySQL problems.
    This type of thing is always interesting to know.
     
    g-Vector, Oct 28, 2009 IP
  15. ASTRAPI

    ASTRAPI Guest

    Messages:
    500
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    As Seller:
    100% - 0
    As Buyer:
    100% - 0
    #15
    Processor : PE R200 Dual Core Xeon 3065 (2.33GHz, 4MB, 1333MHz FSB)
     
    ASTRAPI, Oct 28, 2009 IP
  16. Asako

    Asako Peon

    Messages:
    266
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    As Seller:
    100% - 0
    As Buyer:
    100% - 0
    #16
    The only choices for you is to use load balanced server with dedicated mysql server. You can try a dedicated mysql server with your current server and see if its can handle the load and reques (usually for 1k request persec this should be fine)

    Load balanced server like what most of social networking web use is the best choices if you grew larger more than a million request etc.
     
    Asako, Oct 28, 2009 IP
  17. ASTRAPI

    ASTRAPI Guest

    Messages:
    500
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    As Seller:
    100% - 0
    As Buyer:
    100% - 0
    #17
    Any tutorials on how to do that?

    Load balance?
     
    ASTRAPI, Oct 28, 2009 IP
  18. ishan

    ishan Prominent Member

    Messages:
    2,212
    Likes Received:
    88
    Best Answers:
    0
    Trophy Points:
    325
    As Seller:
    100% - 0
    As Buyer:
    100% - 0
    #18
    Nowadays you will get a much better server for 180$, than your current config. That said, it would be the Disk I/O more than any other thing causing problems. You should look into SAS drives in RAID-1 or the new SSDs.

    If your other requirements like space/bandwidth aren't high then small SAS drives & hardware RAID could be met by some provider.

    Ishan
     
    ishan, Oct 28, 2009 IP
  19. ASTRAPI

    ASTRAPI Guest

    Messages:
    500
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    As Seller:
    100% - 0
    As Buyer:
    100% - 0
    #19
    Some times i can see from the logs that DNS crashing...
     
    ASTRAPI, Oct 29, 2009 IP
  20. theapparatus

    theapparatus Peon

    Messages:
    2,925
    Likes Received:
    119
    Best Answers:
    0
    Trophy Points:
    0
    As Seller:
    100% - 0
    As Buyer:
    100% - 0
    #20
    That's bad.

    Can you move DNS off server, say to OpenDNS or your datacenter's/ box provider's/ Domain registrar's/ some dude who can help's DNS servers and turn off BIND?

    May want to su up to root, run a top, and see what else is going on in there. What's the average (or current even) load?
     
    theapparatus, Oct 29, 2009 IP