Site Kit GTM scripts only active when logged in to WP admin

I installed Google Tag Manager (GTM) as part of Site Kit in WordPress.

My GTM account has a single container, with a single tag (FB pixel) and a single trigger (all pages). GTM works as intended, when I am logged into WP admin. FB Pixel helper reports a FB Pixel is present. And I receive test data in Facebook for the pixel, as expected. As long as I am logged into WP admin, that is.

As soon as I log out of WP admin, the GTM container with the FB pixel is no longer present. FB Pixel helper now reports (after logging out from WP admin) that no pixels are present. And the FB pixel does indeed change from active in the FB event dashboard.

The page I need help with: [log in to see the link]