Had the same problem. Almost panicked and thought my site was gone.
But not to worry, simply open up wp-config.php file through your host file manager. Search for “WP_CACHE” and erase the line “define(‘WP_CACHE’, true); //Added by WP-Cache Manager”
One you save the edit, the plugin will be disabled and you will be able to delete the plugin from the admin page and forget it ever existed.