I have the same issue. When Postman SMTP is enabled all of my plugins that send an email are slow. E.g. When I checkout in WooCommerce, or I post something on BuddyPress forums, it takes about 10 seconds. If I deactivate Postman SMTP it submits in about 1 second.
It feels to me that these plugins send email during submit and the page is not loaded until complete. SMTP obviously takes longer to connected.
Anyone know of a way to speed things up? 10 seconds is way too long.
Andrew