We do use a caching service, but I have cleared the cache multiple times since installing the plugin. When I go to the plugin page on my site, under last optimized images it shows that it has optimized some random images, but nowhere close to all of them.