I would recommend you to use first and third. Wp-super-cache works only ok if it's configured correct, which depends on a server and visitors.
Also keep one thing in your mind that if you are using so many plugins at your wp blog then you can't get good speed as using so many plugins ultimately decrease speed of your blog. DON.
Thanks for your suggestion but I am not using so much plugin but the sites are opening very slow. So ask here for a good plugin.
wp-supercache is the best one, it will create all posts as html pages in the server and decrease the load on db server and will load pages instantly. It's great and highly recommended !
also this plugin may help you for fast upload image http://forums.digitalpoint.com/showthread.php?p=12216268#post12216268