WP Super Cache not recognizing updates

I just used the auto upgrade feature in WP to upgrade the WP Super Cache plugin to 0.8.7. It’s displaying very weird behavior. Updates to my site are visible to me but everyone else see the old pages. I have to manually delete the cache to make the changes visible to the world. Apparently the cache database isn’t being updates for anyone who isn’t logged in (or possibly only for the admin?).

Has anybody experience anything like this? Any solutions that don’t require deleting the cache each time I post or edit?