There is a new PR (feature) coming to Gutenberg and hopefully that will include what is called a gutter between the images, so that one can control the distance between the images in the Gallery block.
At the moment yes one can use CSS to control the margins/padding between the images. Do a search for Inspect and CSS to learn how to find the correct CSS in the layout.