Breadcrumb question

Everything is going great with WP & I’ve customized it/ect., but I was wondering something: Does one HAVE to used a breadcrumb plugin or can this be done via WP? I’m trying to use as little plugins as possible.