Replying to Comments Without Losing Recent Comments

I have both a Recent Comments and a Top Commentators plug-in in my side bar. Currently I have it set so that when I, the site admin, post a comment on one of my posts I don’t show up in the Recent Comments list. The only problem is that when I do leave a comment or reply to one of my comments it eliminates one of the recent comments off of list.
So as an example; I have 8 recent comments showing on my blog in the right side bar. Now if I go and reply to one of those comments, the list will be reduced to 7. And if I reply to another the list will go to 6, and so on and so on. Is there a fix for this?