Plugin disabled but Intercom shows up when user are in VPN

I am running into an issue where I have a US website and a China website which mimics it, and I am running into the issue where Intercom still shows up after it was disabled on the China website. If people are VPN in, they are able to see the Intercom icon located bottom right, but if they are not VPN in, it does not show up. Any thoughts on why this is happening and any solution to fix this?