How to dequeue css from pages that do not contain this widget?

I’d like to remove the “public.css” only from pages that do not contain this widget. I’ve tried something like this:

if ( is_front_page() || is_page() || is_shop() || is_woocommerce() ) {
    wp_dequeue_style( 'recent-posts-widget-with-thumbnails-public-style' );
}

Some of my pages contain this widget. Is there a way to filter the pages that contain this widget instead of dequeuing from all pages?

Thank you.