I am considering moving out of San Diego -- too noisy and congested. Any suggestions?

We would like to be close to the ocean and be in a fairly upscale area but prefer a "small town" feel. Cost is a consideration, but quiet and peaceful are most important.