Member directory does not display a field consistently

I have three custom fields for users called building number, flat number, and shop number. They show okay in wp-admin user –> Info popup. And they are all fine when I use a plugin like User Insights. I’ve created a Member Directory where I have selected these fields for display. For some users the value of Building Number is shown but for others it is not shown. This is a big issue as Building Number has to be seen by logged in users. I have tried to create a new Member Directory, but the result is the same. How can I fix this? Urgent help required.