Woocommerce adding taxes on prices already w. tax

Hi

Woocommerce is adding the tax percentages on top of the product price in the cart, even though I’ve chosen “Yes, I will enter prices inclusive of tax” in the settings. I also have the price be inclusive of tax both on cart and checkout.

I’ve tested to have no tax rate set at all (just to see what happens) and then of course there is no change to my prices.

As soon as I set up a tax rate (standard), the tax % is added on top of my price.

I’ve googled around and have seen this question pop up but never any solutions.
Any help is appreciated.