Default styling for buttons and other blocks

Is there a way to set default styles or disable Gutentor styles?
E.g. buttons display as blue with 3px radius by default. This is drastically different from my theme default styling. Every time I add a button I have to adjust general settings like colours, padding, border, etc. This is so time consuming.
Is there a way around this?