Auto sync by role doesn’t remove users by role

I set up auto sync by role, and did a manual sync. Then I saw I had a test user in there, so I removed the specified role from the test user. After another manual sync, the test user is still on the Mailchimp list. I know the user will be removed if I delete it, but is that the only case in which a user will be removed by design?