Hide wrapper if no comments

What template do I edit if I want to hide the wrapper when there are no comments?

I actually want to hide the wrapper on all pages but show it on all blog posts. I don’t know how to do that or which template to look in/edit.