Prevent individual category from appearing on frontpage

I would like to prevent posts, designated by a specific category, from appearing in the front page of my blog. I basically want a widget on my sidebar to link to the most recent post under this category but I don’t want these posts to be included the feed that appears on my front page. I wouldn’t care if this category appeared in my normal RSS feed I just want to prevent it from pushing more important posts off of my frontpage as this category will be updated frequently. Can this be done? I think I can find a widget that fits what I’m trying to do but I’m stuck with the front-page stuff.