Thanks @Rumejan, I appreciate the insight!
It would be great if I could change that rel canonical to https regardless, since when search engines are redirected to the https version they still see the http version as the canonical.
Ultimately it may be a non-issue, since the 301 will override the canonical, but still seems like mixed messages are being sent. But I don’t see any way to make this change in bulk in Yoast.