I’m so happy to be able to share this because I’d been trying to figure this out for some time. There’s actually a whole menu dedicated to Gallery at the top of the screen in the Dashboard view. Click there and Manage your gallery. Once there, you should see all the photos in the chosen gallery and be able to add captions one by one. Tags, too.
I hope this helps!