Hey guys, I wanted to find out if any of you know how actually build a web server from scratch (not using your computer as one). I am planning on building a 10TB web server(for video content) and actually also have enough room to handle the traffic bandwidth as well. If anyone could point me in the right direction I would be most appreciative. Thanks in advance JD
How much of an extreme are you talking about? Building a server from "scratch" leaves a lot of room for interpretation..... We talking about loading a custom OS via KVM? We talking about a custom set, manaully compiling everything? We talking about a easy setup using a package manager?
Not a Package Manager. And yes loading a custom OS and manually compiling everything. I just wanted to know basically exactly how to build one, can't really find any good tutorials online for building a web server.
Well, thats a tall order to make a post here about, simply making a how-to for a server OS install thru a KVM/Drac isnt quick. As far as the OS, everyone has their own preference, mine being Gentoo, so thats an entirely new how-to as well. If your really going to manually compile everything, the how-to for that would be a monster.
Could you suggest any tips or websites then that I should start reading. Maybe some websites explaining different types of OS i should install and why etc Thanks
There are a lot out there, but im not sure ive ever seen a nice how-to for a server OS install thru a KVM/Drac, if i happen along one, ill come back and post it for you. As for the OS, thats all a matter of user preference as i said, i prefer Gentoo, for many reasons, one being the ease of editing one file and adding the build switches to it, then building. If your not going to use a package manager, the switch options for an given program, apache/php/sql etc, all have to be passed at the cmd line when you configure them, which can lead to you reading and figuring out what you actually want on/off or needing etc.
What is a package manager? Also, is it just easier to build a computer with 10TB worth of hardrive space and then install the relevant OS on top of that for the server? In addition, is there any way to calculate exactly how much RAM, space and what type of processor I will need? Thanks for all the help so far as well
A package management system, aka "package manager", is a collection of software tools to automate the process of installing, upgrading, configuring, and removing software packages for a computer's operating system in a consistent manner. It typically maintains a database of software dependencies and version information to prevent software mismatches and missing prerequisites. As far as hardware goes, that can vary widely, depending on how critical the data is, the best option is Raid 10, for speed & reliability, same goes for RAM & CPU, there is really no way to "calculate" what you will need at this point until it actually grows with activity of the users. If this is going to be based on a PHP/SQL type content site, then the hardware requirements just grew greatly, compared to a static base design.
Basically the site is a PHP/SQL website. It is a video on demand website something sort of like NetFlix, LoveFilm, Hulu etc That is also why it has to be 10TB to accomodate the content. How have the hardware requirements grown greatly, by how much? Can a web server allow for more hardrive space to be added to it after the RAID has been configured or no, this means the RAID will have to be configured again?
The resources requirement will grow considerably when running a php/sql based website versus a static based website (html pages), as for the RAID container, no, you cant simply reduce/grow the container once its built.
Depends on the RAID controller. Generally, the more expensive the controller, the more features it has. Some controllers allow on-the-fly conversions from different RAID levels e.g. RAID5 to RAID10 or RAID6, and some do allow additional drives to be added to an existing array if there's enough drive connections. You're not going to find this on cheap controllers (less than, say, $500), and you'll need to check the manufacturers site for information on what features are available for the controller and OS you're using. With cheaper controllers, if you want to add more drives, you generally have to start again from scratch.
I saw in your signature that you might be doing some work with servers. Is that your specialty? What servers are out there? What is the best in your mind? If you don't have much to spend is there some quality for a low budget? Thanks.
WOW- 10TB from scratch- I have to wish you good luck, you would have to be pretty smart and dedicated to pull that off.