The four most likely possibilities for this problem that I suggest you check first are:
- WordPress thinks you are logged on; this occurs when you logout from one Site URL, and access your site from another URL; even
www.example.com
and example.com
are treated as separate logons by WordPress; the only convenient way to eliminate this as the cause of your problem is to logout and delete all cookies in your browser that match the Site URLs that could be used to access your site;
- Be sure that you are using the same site’s Settings page for the plugin, as the site you are checking for privacy;
- Find out if you have any plugins that Cache; if so, you will need to “flush” the cache (for the same site) every time you change a Setting in my plugin; during testing, it would be better to disable Caching altogether;
- Flush your browser’s cache, or try another browser
#1 is the toughest one to deal with. But it is the most likely cause, especially if you use the WordPress MU Domain Mapping plugin.
#1 is also not really a problem, as your site is actually protected from others, even though you can see the site yourself.
As you can see, there are lots of possibilities. If you want more help, please feel free to respond.