Jetpack disable post notification but not comment notification

I have the Jetpack subscription turned for a blog I manage. We used to allow people to subscribe to both posts and comments, but since Jetpack doesn’t give you much control over how the notification emails look, we decided to go with another plugin for new post notifications.

I’ve turned the option off to subscribe to posts alerts, but post notification emails are still going out to people who had previously subscribed. Is there anyway to stop this? I don’t want to disable the whole Jetpack Subscription plugin since we still want people to be able to subscribe to comment notifications. Thanks!