Address on Subscription

When someone signs up to my newsletter via the sidebar signup and confirms their subscription through email, it shows my address on the “subscription confirmed” page. How do I get rid of this as I don’t want random strangers to have my address.