yeah you upload all the files excluding the wp-content directory and wp-config.php file. Then access the wp-admin area. It will ask permission to update the database or something. Click on the button and upgrade will be complete. You can also do it via admin area like snakeair suggested, which is a much better option.