Password Protecting the Admin Panel

Is there a downside to password protecting the wp-admin directory via an .htaccess file? I know a password is required to log in anyway, but since all software has security flaws now and then, I thought the extra level of security might add some reassurance.