category rss images, li categories, and positioning

Okay,

I want to use the category rss images options in WordPress to offer category rss feeds. However, WordPress defaults side bar categories into
li tags, which ends up looking terrible in my theme (they appear underneath it). I want those feed icons to appear beside the category, not underneath it. What’s the best way to go about that?

I would just use css, but I have other images in li tags that I don’t want to end up styling while trying to get a grip on these images. Also, I can’t seem to get them to style where I want them to be anyway.

Here’s the link: https://www.mythopia.net