How to stop creating duplicate images when using media_handle_sideload ?

I’m adding an attachment using media_handle_sideload and if the attachment is a image that is already in the site’s media library it still makes a duplicate image and adds it to the media library. I tried doing this also with wp_insert_attachment but I still get the same result. Any ideas?