At least, that was enough to get the test mail to send using PHP code. Updating the actual address still fails. And one thing I left out as well that I just realized that probably makes a difference, this is also a multi-site install.
Testing mail via PHP works fine. Changed the main site admin mail to the new domain and still didn’t receive any mail. Changing any site mail supposedly generates a message but we’re not getting any of those messages either.