@betterend That really depends… removing a block using the Block Manager can make it so some blocks do not load their frontend assets (css/js etc), but the majority of core Gutenberg blocks will have the assets bundled so they would still be loaded.
this is really just a plugin to clean up the page building experience.