Site-map and 404 for FAQ

I have created three FAQ groups, and the functionality is working well for what I need.

Each of the FAQs appears to create a permalink based on the URL slug, but if you try to go to that permalink address, you get a 404 error.

Unfortunately, these permalinks are being included in my site-map, and google is reporting there are now 20+ 404 errors. I’m concerned this will hurt my SEO score.

I am using the “Google XML Sitemaps” plugin to generate my site-map.

Is there a way to stop these permalinks from being created, or to stop them from being included in the site-map?