Well, it is "just a few numbers" or "most of my incoming calls"?? That sounds like two different things.
As noted above, Caller ID is a carrier function. You should contact your carrier.
It's not a function that you can change on your device. Or ask the people calling if they are blocking their own number from showing.