So I have been playing a bit more and found the problem is as follows:
The choices displayed depend on what entries are in the member data, not those in that have been configured as the choices for the field.
So if I have choices as Yes and No, but only Yes has been selected then I cannot choose No in the list. The choices should be a union of the configured choices and the data in the member records, or just the configured choices.
