@dylanspurgin
Thanks a lot! I tried the FCKEditor plugin and the TinyMCE Advanced plugin, like some people mentioned, but still WordPress was adding p-tags like crazy.
Removing the wpautop filter by putting your line in my functions.php did the trick. It won’t effect existing posts, but I only just started my blog so luckily there aren’t many pages to update.