I expect that would actually disable your caching if you just renamed object-cache.php and did nothing else.
I did not try deleting/reinstalling (which would probably work since it would re-install back the appropriate caching files), but I did do the rename trick, that allowed me access to the admin panel, then disabled my caching (SG SuperCacher – Memcached option) then re-renamed the caching file back to object-cache.php, then re-enabled my caching. And everything is working fine again.