Each custom field has it's very own permission settings for granular control over who can see, view and even edit each particular custom field.
Navigate to Settings.
Go to Custom fields, select a custom field type, and edit/create a custom field.
Scroll down to Field permission to set the permission level for each role in your workspace.