After much research and reading various reviews, articles, and the positives and negatives, I purchased my first bitcoin. I decided to use Coinbase – https://www.coinbase.com
They are the first US-based exchange and they recently gained approval from 25 states, including New York and California, and have plans to operate in 30 countries
After reading this article on Engadget and additional profiles that they have completed, I felt that Coinbase was a good place to start and get my feet wet.
http://www.engadget.com/2015/01/26/bitcoin-first-licensed-us-exchange/