If it can help someone. I figured out that by creating a custom block with ACF plugin, it will force the editor to stay in non-iframed mode, thus removing that annoying resize handle.
Here is an example of custom block code to place in functions.php :
/**
* WP EDITOR WORKAROUND
* add fake custom block to force gutenberg editor to stay in non-iframed mode
*/
if( function_exists('acf_register_block_type') ){
add_action('acf/init', function(){
acf_register_block_type([
'name' => 'my_custom_block',
'title' => 'Custom Block',
'mode' => 'edit'
]);
});
}