Only way I was able to do it was to do the following, it would be nice if there was a setting to disable them.
add_filter('glossary_tooltip_html', 'se_disable_terms_in_glossary');
function se_disable_terms_in_glossary($excerpt) {
return do_shortcode('[glossary-ignore]' . $excerpt . '[/glossary-ignore]');
}