Bug or is it just my theme?

It should be possible to fix the output with some css. I cannot provide a working layout for every theme, because the used css in the themes differs very much and something which is working in one theme is a problem in another one.

You can add custom comment list styles in the comment guestbook settings. Sorry that I cannot provide support for every layout problem.