New and Deleted Posts not updating under categories

All righty, so I’m having trouble with a few things. Not huge, but also not sure how to fix them.

It would appear that while myself and other users on my WordPress site (8bitfoundation.com) are logged in, everything is fine. BUT, when I log out, posts are not where they should — or should not — be. New posts are not updating themselves under my designated categories, and old posts that I have deleted are not deleting themselves from their old spots. Everything is fine and published if you search via the home page, though. It should also be noted that everything is updated and/or deleted when you check it from a smart phone.

I’m not quite sure how to handle this, as (like I said) everything is just as it should be while I am logged into my admin panel or checking from a smart phone. Is this a cache issue? Or could it be 3.51 not playing well with my theme? Any and all help is appreciated!

–Jack