I did fixed the problem.
Install the WP Mail SMTP plugin and make sure the reply address is a valid email address. I have a special no-reply account to prevent my mailbox from filling up with spam. This applies to any contact form plugins as well. This may be dependent upon your mail server. Let me know if this works.