Enable moderation, but let posts display by default?

When I turn on moderation, it doesn’t post anything until I approve it first. Is it possible to do this in the reverse? I’d like to let everything post by default, but have the ability to remove a post if I want.

Thank you!