Thank you Adpubster I am going to do this for I can see how much time/work it can save. Just like with a change in a css file effects all pages instead of changing them all manually one by one. (of course when I think about it files ending with .html go to that directory, silly me!)
You can just rename ANY .html, .htm page to .php and it works. Or you can use the HTML include code (which I think was actually posted below) lol.