User Search

Hello,
So, I’m running 3.5.1 and have a custom theme based off of TwentyEleven. I havn’t changed any code in regards to searching for users, but I find that my user search results are really slim.
What i mean by that is, the search results for “David” will say that there are 232 “items” as a result (this is not hypothetical, I actually did this and the numbers I’m giving are actually what resulted). The problem is that there are only 5 pages of results, each page showing only 3 or 4 users.

So really what I’m getting from my search for “David” is only about 20 users as opposed to the 232 that it says are there.

How can I fix this? I have over 1,000 members in my site, and having poor search really affects me in a negative way. Any help and tips greatly appreciated!

Thanks!