Okay I figured it out, the wording on the option description was the opposite of what it should be. Disable metaboxes should be set to No. Now I can see the option to disable cache on each page (the description says the opposite leading to the confusion).