Found a solution to this, its an ugly one but it does get around the issue for me.
on_sent_ok: "$("#post-440").empty();window.location.replace('https://www.url.com.au/thank-you/');"
Where post-440 is the ID of the div which surrounds the form. Put simply your post led me to the belief that IE is somehow passing that form again before doing the redirection, this uses jQuery to clear that entire page of content (including the form) before doing the redirection.
Its a hack way to get around the IE issue but so far its working in all browsers for me including IE11.