auto br but not p for comments?

I know how to turn off the automatic line and paragraph breaks by commenting out:
add_filter(‘comment_text’, ‘wpautop’);
in the vars.php file. But I wanted to know if there was a way to get rid of the automatic paragraph breaks but keep the automatic line breaks for the comments.