It turned out that I was wrong about the plugin.
My hosting partner installed a login form for extra security without telling me, so I confronted them and they told me why they had to do it.
So, I re-installed the math captcha again and everything is now fine ??