How to Build A Web Server For Website Hosting From Scratch?

Discussion in 'Site & Server Administration' started by jskapur, Sep 19, 2011.

  1. #1
    Hey guys,

    I wanted to find out if any of you know how actually build a web server from scratch (not using your computer as one).
    I am planning on building a 10TB web server(for video content) and actually also have enough room to handle the traffic bandwidth as well.

    If anyone could point me in the right direction I would be most appreciative.

    Thanks in advance

    JD
     
    jskapur, Sep 19, 2011 IP
  2. AnthonyG

    AnthonyG Well-Known Member

    Messages:
    114
    Likes Received:
    3
    Best Answers:
    2
    Trophy Points:
    135
    #2
    How much of an extreme are you talking about?

    Building a server from "scratch" leaves a lot of room for interpretation.....

    We talking about loading a custom OS via KVM?

    We talking about a custom set, manaully compiling everything?

    We talking about a easy setup using a package manager?
     
    AnthonyG, Sep 19, 2011 IP
  3. jskapur

    jskapur Active Member

    Messages:
    144
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    81
    #3
    Not a Package Manager.
    And yes loading a custom OS and manually compiling everything.

    I just wanted to know basically exactly how to build one, can't really find any good tutorials online for building a web server.
     
    jskapur, Sep 19, 2011 IP
  4. AnthonyG

    AnthonyG Well-Known Member

    Messages:
    114
    Likes Received:
    3
    Best Answers:
    2
    Trophy Points:
    135
    #4
    Well, thats a tall order to make a post here about, simply making a how-to for a server OS install thru a KVM/Drac isnt quick. As far as the OS, everyone has their own preference, mine being Gentoo, so thats an entirely new how-to as well. If your really going to manually compile everything, the how-to for that would be a monster.
     
    AnthonyG, Sep 19, 2011 IP
  5. jskapur

    jskapur Active Member

    Messages:
    144
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    81
    #5
    Could you suggest any tips or websites then that I should start reading.
    Maybe some websites explaining different types of OS i should install and why etc

    Thanks
     
    jskapur, Sep 19, 2011 IP
  6. AnthonyG

    AnthonyG Well-Known Member

    Messages:
    114
    Likes Received:
    3
    Best Answers:
    2
    Trophy Points:
    135
    #6
    There are a lot out there, but im not sure ive ever seen a nice how-to for a server OS install thru a KVM/Drac, if i happen along one, ill come back and post it for you.

    As for the OS, thats all a matter of user preference as i said, i prefer Gentoo, for many reasons, one being the ease of editing one file and adding the build switches to it, then building.

    If your not going to use a package manager, the switch options for an given program, apache/php/sql etc, all have to be passed at the cmd line when you configure them, which can lead to you reading and figuring out what you actually want on/off or needing etc.
     
    AnthonyG, Sep 19, 2011 IP
    jskapur likes this.
  7. jskapur

    jskapur Active Member

    Messages:
    144
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    81
    #7
    What is a package manager?
    Also, is it just easier to build a computer with 10TB worth of hardrive space and then install the relevant OS on top of that for the server?
    In addition, is there any way to calculate exactly how much RAM, space and what type of processor I will need?
    Thanks for all the help so far as well
     
    jskapur, Sep 19, 2011 IP
  8. AnthonyG

    AnthonyG Well-Known Member

    Messages:
    114
    Likes Received:
    3
    Best Answers:
    2
    Trophy Points:
    135
    #8
    A package management system, aka "package manager", is a collection of software tools to automate the process of installing, upgrading, configuring, and removing software packages for a computer's operating system in a consistent manner. It typically maintains a database of software dependencies and version information to prevent software mismatches and missing prerequisites.

    As far as hardware goes, that can vary widely, depending on how critical the data is, the best option is Raid 10, for speed & reliability, same goes for RAM & CPU, there is really no way to "calculate" what you will need at this point until it actually grows with activity of the users.

    If this is going to be based on a PHP/SQL type content site, then the hardware requirements just grew greatly, compared to a static base design.
     
    AnthonyG, Sep 19, 2011 IP
  9. jskapur

    jskapur Active Member

    Messages:
    144
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    81
    #9
    Basically the site is a PHP/SQL website. It is a video on demand website something sort of like NetFlix, LoveFilm, Hulu etc
    That is also why it has to be 10TB to accomodate the content.

    How have the hardware requirements grown greatly, by how much?
    Can a web server allow for more hardrive space to be added to it after the RAID has been configured or no, this means the RAID will have to be configured again?
     
    jskapur, Sep 19, 2011 IP
  10. AnthonyG

    AnthonyG Well-Known Member

    Messages:
    114
    Likes Received:
    3
    Best Answers:
    2
    Trophy Points:
    135
    #10
    The resources requirement will grow considerably when running a php/sql based website versus a static based website (html pages), as for the RAID container, no, you cant simply reduce/grow the container once its built.
     
    AnthonyG, Sep 19, 2011 IP
  11. RonBrown

    RonBrown Well-Known Member

    Messages:
    934
    Likes Received:
    55
    Best Answers:
    4
    Trophy Points:
    105
    #11
    Depends on the RAID controller. Generally, the more expensive the controller, the more features it has. Some controllers allow on-the-fly conversions from different RAID levels e.g. RAID5 to RAID10 or RAID6, and some do allow additional drives to be added to an existing array if there's enough drive connections. You're not going to find this on cheap controllers (less than, say, $500), and you'll need to check the manufacturers site for information on what features are available for the controller and OS you're using. With cheaper controllers, if you want to add more drives, you generally have to start again from scratch.
     
    RonBrown, Sep 19, 2011 IP
  12. mcwahl

    mcwahl Member

    Messages:
    56
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    43
    #12
    I saw in your signature that you might be doing some work with servers. Is that your specialty? What servers are out there? What is the best in your mind? If you don't have much to spend is there some quality for a low budget?

    Thanks.
     
    mcwahl, Sep 20, 2011 IP
  13. sambling

    sambling Well-Known Member Affiliate Manager

    Messages:
    954
    Likes Received:
    9
    Best Answers:
    1
    Trophy Points:
    100
    #13
    WOW- 10TB from scratch- I have to wish you good luck, you would have to be pretty smart and dedicated to pull that off.
     
    sambling, Sep 20, 2011 IP