After analyzing plugin’s code, it seems that plugin first lets all comments to be submitted, and only later removes them from the database if nocaptcha answer fails.
I do not think that this is optimal mode of operation. It would be better to prevent entering comment in the first place. This is why we get email notifications, after all, but once admin check dashboard > comments, there is none, because it was removed by the plugin.