1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.
  2. Better Analytics for WordPress Get It Free

Wow

Discussion in 'Support & Feedback' started by digitalpoint, Nov 30, 2007.

  1. #1
    I am exhausted...

    Sequence of events...

    The cluster lost one of the blades today for the first time ever (this blade is the 2nd master DB server). The primary master writes everything to the 2nd master, then the 2nd master replicates out to all the slaves (read only access). Something happened with mysqld before, but this time it was a hardware issue.

    I screw with it remotely as best I can. Once I figure out it's a hardware problem, I go to data center.

    The blade is on, but not able to be pinged. Okay.... let's just power cycle it.

    Weird, the power button doesn't work on the blade.

    Let's try to power cycle a backup (currently unused blade) to see if it's the blade or I'm an idiot and forgot how to use the power button on the computer. Hmmm.. this blade won't turn off either.

    Okay, let's just try to power cycle the whole bloody array of blades (master power button on the chassis). Wow... the chassis won't even turn off. Neat.

    Okay, let's just unplug the God damn chassis, reset whatever logic controls the power buttons... {unplug} ......wait..... {plug back in}

    Power button is amber (meaning we have power, but we haven't turned on the chassis)... good. Let's turn it on. Uh yeah... this power button still doesn't work. Except now all 10 blades are turned off... nifty.

    {call Dell tech support} Not that I thought it would do much good (it's 11:00 pm now), and it's been over a year, so I'm sure this stuff is out of warranty. What the fuck? Someone knowledgeable is on the phone in about 30 seconds. Another 30 seconds and he concludes I'm not an idiot and the chassis itself has hardware problems (not responding to power buttons on it).

    Lovely I'm thinking, I'm gonna go to Hawaii for the weekend, so I don't have to deal with website being down for a few days while they try to find parts.

    So then the dude on the phone tells me he can have a tech there with every part possible for the chassis 2 hours to get it up and running. Which they actually did. He gutted the chassis, replaced a few circuit boards in it and also the main internal housing for good measure.

    Weeee.... it works!

    Had to reconfigure some stuff with the chassis (remote control and stuff since it was new hardware).

    I have figured out that blade8 (the one that went missing earlier) has some sort of issue and is hanging halfway through it's boot sequence... But you know what? I'm tired, it's 4:00 am... we are gonna run on a single DB server for today and I'll come back tomorrow with serial ables so I can watch the boot sequence spew crap on that blade to see what's up.

    But I do have to say... to have Dell show up at 1:00 am with parts and all that was pretty cool. Can I go home and go to bed (I'm sitting in the data center now) and deal with blade8 tomorrow? k, thanks.
     
    digitalpoint, Nov 30, 2007 IP
    TGS, sundaybrew, mcfox and 1 other person like this.
  2. Games master

    Games master Well-Known Member

    Messages:
    1,092
    Likes Received:
    97
    Best Answers:
    0
    Trophy Points:
    115
    #2
    Good going! :D

    Edit : Wow! So many members viewing this thread!
     
    Games master, Nov 30, 2007 IP
  3. sachin410

    sachin410 Prominent Member

    Messages:
    6,420
    Likes Received:
    572
    Best Answers:
    0
    Trophy Points:
    360
    #3
    whatever.....happy that DP is back....I was having a miserable day. :p.
     
    sachin410, Nov 30, 2007 IP
    it career likes this.
  4. qprojects

    qprojects Peon

    Messages:
    1,901
    Likes Received:
    103
    Best Answers:
    0
    Trophy Points:
    0
    #4
    I was going mad without DP, now we know the worth of DP :D
     
    qprojects, Nov 30, 2007 IP
  5. M.IMRAN

    M.IMRAN Well-Known Member

    Messages:
    843
    Likes Received:
    39
    Best Answers:
    0
    Trophy Points:
    100
    #5
    dp is back!...............thank God
     
    M.IMRAN, Nov 30, 2007 IP
  6. nobitu

    nobitu Banned

    Messages:
    1,789
    Likes Received:
    25
    Best Answers:
    0
    Trophy Points:
    0
    #6
    phu``````````````````

    Thanks admin!!!!
     
    nobitu, Nov 30, 2007 IP
  7. Richie_Ni

    Richie_Ni Prominent Member

    Messages:
    10,729
    Likes Received:
    1,175
    Best Answers:
    0
    Trophy Points:
    360
    #7
    Finally it's back!!
     
    Richie_Ni, Nov 30, 2007 IP
  8. rahmat

    rahmat Active Member

    Messages:
    270
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    60
    #8
    Thanks!!
    Finally I can access dp again.
     
    rahmat, Nov 30, 2007 IP
  9. Alonski

    Alonski Active Member

    Messages:
    1,572
    Likes Received:
    16
    Best Answers:
    0
    Trophy Points:
    90
    #9
    Ah good DP woohoo. I wake up in the morning and think of some new threads then this happens. Now I forgot them =(
     
    Alonski, Nov 30, 2007 IP
  10. it career

    it career Notable Member

    Messages:
    3,538
    Likes Received:
    155
    Best Answers:
    0
    Trophy Points:
    220
    #10
    It was so boring working at office without access to DP :D
     
    it career, Nov 30, 2007 IP
  11. Indian_Webmaster

    Indian_Webmaster Banned

    Messages:
    1,298
    Likes Received:
    61
    Best Answers:
    0
    Trophy Points:
    0
    #11
    Good work Shawn.. Thanks for your hard work for us !!
     
    Indian_Webmaster, Nov 30, 2007 IP
  12. shenron

    shenron Notable Member

    Messages:
    4,966
    Likes Received:
    375
    Best Answers:
    0
    Trophy Points:
    245
    #12
    Whatever Shawn... All we can do is Thank You! And Thank you Dell! :p
     
    shenron, Nov 30, 2007 IP
  13. DN Webmaster

    DN Webmaster Guest

    Messages:
    551
    Likes Received:
    95
    Best Answers:
    0
    Trophy Points:
    0
    #13
    Thanks .Nice Job :D

    DN :)
     
    DN Webmaster, Nov 30, 2007 IP
    it career likes this.
  14. sundaybrew

    sundaybrew Numerati

    Messages:
    7,106
    Likes Received:
    1,244
    Best Answers:
    0
    Trophy Points:
    510
    #14
    Thats awesome for sure .

    This could be a DELL commercial :)

    I am sure they will be pleased to hear such a nice comment from a huge forum owner,

    The fact that the servers were $85k might have helped as well :eek:
     
    sundaybrew, Nov 30, 2007 IP
  15. AutumnBreeze

    AutumnBreeze Peon

    Messages:
    1,033
    Likes Received:
    101
    Best Answers:
    0
    Trophy Points:
    0
    #15
    Now you can go to Hawaii for the weekend :p
     
    AutumnBreeze, Nov 30, 2007 IP
  16. DomainMagnate

    DomainMagnate Prominent Member Premium Member

    Messages:
    10,873
    Likes Received:
    1,008
    Best Answers:
    0
    Trophy Points:
    395
    #16
    Shawn why don't you hire someone to mess with the server?
     
    DomainMagnate, Nov 30, 2007 IP
    it career and paidhosting like this.
  17. lkj

    lkj Peon

    Messages:
    729
    Likes Received:
    17
    Best Answers:
    0
    Trophy Points:
    0
    #17
    Glad to hear all is sorted, but I have always preferred normal rackmount servers over blades... too much of the hype... heating...price to performance etcetc
     
    lkj, Nov 30, 2007 IP
  18. juniper

    juniper Guest

    Messages:
    1,300
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    0
    #18
    thanks Nice job DELL
     
    juniper, Nov 30, 2007 IP
  19. Bender

    Bender Peon

    Messages:
    1,403
    Likes Received:
    358
    Best Answers:
    0
    Trophy Points:
    0
    #19
    I was gonna have a heart attack! :D
     
    Bender, Nov 30, 2007 IP
    it career and paidhosting like this.
  20. Boulder

    Boulder Peon

    Messages:
    806
    Likes Received:
    46
    Best Answers:
    0
    Trophy Points:
    0
    #20
    Thanks Shawn! It is good to know that You and Dell are taking such good care of us.. We can not function with out this place... LOL

    I am sure glad you got it pinned down, before you scoot off over to Hawaii..

    Have a fun time and vacation over on the Islands.. Thanks again.. :D

    Boulder
     
    Boulder, Nov 30, 2007 IP