Creating category archives for custom post type

I have a custom post type “gallery” which I enabled category support, so it uses the came categories as my posts.

I want to have category archives for my custom post type. I can achieve this by typing in the URL /gallery/?category_name=portraits. However, I would like the URL to be a little cleaner than that, maybe something like /gallery/category/portraits/.