I’m new but noticed no one had posted what they found to fix it. I was getting two emails for each comment also. I’m using WordPress 3.8.1
I fixed it on mine by making sure my User Profile email was the same as the General Settings email. Now I only get one email per comment submitted.
I had a different email in each area.