No email sent when comments post automatically

When the box is checked for “An administrator must always approve the comment”, I receive an email when someone adds a comment. But when the box is not checked, I don’t receive an email when a comment is posted.

Is that the way it should work, or is something wrong?
I would still like to receive an email when a comment is posted.

Using Neoclassical theme.

Please help. Thanks.