Woohoo! I found this thread while having the same experience as the users above and listened to the suggestion of @webdevmattcrom. I activated an SSL cert on the site and the next payment was marked pending rather than failed and did not send the failed receipt to the customer.
Thank you so much Give, for creating and maintaining a rockin’ plugin. You’re awesome.