The hidden field workaround did not work.
But what did work was going to Woocommerce>Settings>Payments and next to Customer Profiles, uncheck the box “Allow customers to securely save their payment details for future checkout.”
But we have Woocommerce subscriptions plugin and use, so this is going to be an issue as payment info needs to be saved.