Dedicated Server - Digg Front Page - Internal Server Error

Discussion in 'Site & Server Administration' started by Gatorade, Dec 2, 2007.

  1. #1
    I have a dedicated server, and whenever my site hits the front page of digg it still gets the internal server error due to to many hits at once. I do use a cache as well to help.

    Is there an adjustment or something I can make to allow for more cpu?
     
    Gatorade, Dec 2, 2007 IP
  2. thenetninja

    thenetninja Peon

    Messages:
    314
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    0
    #2
    cache is the first thing i would do, the second would be the trim down any unnecessary processes which may be running
     
    thenetninja, Dec 2, 2007 IP
  3. Fedorpheux

    Fedorpheux Active Member

    Messages:
    710
    Likes Received:
    16
    Best Answers:
    0
    Trophy Points:
    80
    #3
    Definitely do a check of what processes are running. For example, see how many database queries your server has to do for each page load. Trim it down on at least the target page, if not on the rest of the site as well.
     
    Fedorpheux, Dec 2, 2007 IP
  4. thenetninja

    thenetninja Peon

    Messages:
    314
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Yes the SQL query count is one of the major reasons why sites fall over in a Digg rush. If you have nested queries for instance, you would be better off reworking the queries as either JOINS or multi table queries.
    The aim would be to get as much information from one query as possible!
     
    thenetninja, Dec 2, 2007 IP
  5. pj1s

    pj1s Active Member

    Messages:
    337
    Likes Received:
    10
    Best Answers:
    0
    Trophy Points:
    60
    #5
    Give more info ... only thing I can say is have a small html page with no sql queries on the front ...
     
    pj1s, Dec 4, 2007 IP
  6. Gatorade

    Gatorade Peon

    Messages:
    2,130
    Likes Received:
    222
    Best Answers:
    0
    Trophy Points:
    0
    #6
    I've made some adjustments to my server that may help some.
     
    Gatorade, Dec 4, 2007 IP
  7. ismu

    ismu Peon

    Messages:
    247
    Likes Received:
    5
    Best Answers:
    0
    Trophy Points:
    0
    #7
    I wonder how they configured the server for digg.com itself to handle such traffic.
     
    ismu, Dec 6, 2007 IP
  8. Agent_Dweeb

    Agent_Dweeb Peon

    Messages:
    5,607
    Likes Received:
    384
    Best Answers:
    0
    Trophy Points:
    0
    #8
    I doubt it is just one server, probably a cluster of servers.
     
    Agent_Dweeb, Dec 6, 2007 IP
  9. Fedorpheux

    Fedorpheux Active Member

    Messages:
    710
    Likes Received:
    16
    Best Answers:
    0
    Trophy Points:
    80
    #9
    It's most certainly more than one server.

    One of my sites on a VPS recently hit the front page of Digg. It went down almost instantly but I logged into WHM and noticed that it was mainly Apache that was having serious issues. I simply restarted that service and the website was back up. I had to do it a couple times over the space of a few hours, and it worked pretty well. I'm not sure if that's exactly what you're supposed to do, but I did it and it seemed successful.
     
    Fedorpheux, Dec 6, 2007 IP
  10. Agent_Dweeb

    Agent_Dweeb Peon

    Messages:
    5,607
    Likes Received:
    384
    Best Answers:
    0
    Trophy Points:
    0
    #10
    And with shared hosting, you will be down in seconds.
     
    Agent_Dweeb, Dec 6, 2007 IP
  11. Gatorade

    Gatorade Peon

    Messages:
    2,130
    Likes Received:
    222
    Best Answers:
    0
    Trophy Points:
    0
    #11
    I rebooted the server and the site was back up for about a minute and the it went down again.

    Shared hosting definitely won't last long. They will think the server is under attack.
     
    Gatorade, Dec 6, 2007 IP
  12. thenetninja

    thenetninja Peon

    Messages:
    314
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    0
    #12
    attack, most certainly. We shut down VPS' and Shared accounts here at work when they start affecting the other clients. I think we have 10 - 11 temporary shutdowns performed on average each day from the digg effect on servers which are not intended for that sort of traffic, or cannot handle it without affecting the other clients on the box.
     
    thenetninja, Dec 6, 2007 IP
  13. ismu

    ismu Peon

    Messages:
    247
    Likes Received:
    5
    Best Answers:
    0
    Trophy Points:
    0
    #13
    I thought so.

    Anyway, is using LiteSpeed (www.litespeedtech.com) really faster than apache? anyone tried it?
    may be this can be an alternate solution for single server ;)
     
    ismu, Dec 7, 2007 IP
  14. edynamite

    edynamite Active Member

    Messages:
    165
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    53
    #14
    I recommend Private Dedicated Servers if you are ready to experience Digg FrontPage. I am a power user at Digg, FP sends HUGE traffic, My servers always crashed when I was on Shared hosting .
     
    edynamite, Jun 24, 2009 IP