I am agree with you that most peoples search by "www", but it we talk about SEO Search engines like small ulrs so there is no use of www and it makes url long. if your website is already running then don't change it, but if you are planning for a new one then without www would be the better option.
stick to one. and create a 301 redirect. i recommend www since some directories require www when submitting.