Listing all categories and posts!?

Seems like a simple thing to do but can’t find a plugin for it.

I want it to output a list of all posts in a hierarchy of their categories like this:

fruits
— bananas
— pears
— apples
Tutorials
— how to fall asleep
— how to brush your teeth

Kinda like a sitemap but without pages. Any help would help.