I was just trying some things, and I uninstalled wp-piwik and reinstalled it using the built in installer method (I just fixed my FTP settings, before I was uploading the wp-piwik folder to a different directory and then moving it in place via SSH). Now it shows the cache setting on the tracking tab!?
With caching turned off, it works great. I am not sure what happened or why the cache option suddenly showed up, but thank you for the help!
Jacob