Theme switching issue

I’ve been wanting to use the theme switcher for quite a while, but when I do, I hate how the comments template for each theme shows the default one. When each theme is used on it’s own, the comments wil only match the active theme. As soon as I implement switching, all comments boxes for all four themes look the same. How do I change this behavior?