I have a similar problem with punctuation, but in my case, the apostrophe (‘) shows as a question mark (?) when I view the page in a browser. However, when I edit or create in the WP admin area, the apostrophe is still there.
Anybody knows what’s wrong?