HI JKBrennan,
I’ve found a solution. Desperate I switched to W3TC. The problem was still the same. But then I found the option that was causing the problem.
Try to tick off all the “Enable HTTP (gzip) compression” under the “browser cache” section. It should word nicely.
I haven’t tried with WP Super Cache. Maybe there is the same kind of option.