Site slow when activated

I idea of this plugin is excellent. I activated it and then required authentication for the users endpoint and it made my site extremely slow.

Any ideas if this can be fixed. For security reasons I do not want to allow people to view the users endpoint unless they are authenticated.