After digging into this more I found that it is being caused by the page cache option. Minify, database cache, object cache, CDN are all working 100%, as soon as the page cache is disabled the internal error goes away…
Hopefully this can help someone possibly figure out a fix!