I had to nest it inside of a conditional if statement to get the admin piece to work correctly
// don't load visual slide box plugin bootstrap js
function remove_bootstrap_js(){
wp_dequeue_script('bootstrap_js');
}
if ( ! is_admin() ) {
add_action('wp_print_scripts', 'remove_bootstrap_js');
}
