Ken,
Unfortunately, this cannot be done. The Custom Field using Reference to Object only allows you to reference one object not multiple. A possible workaround would be to configure the field as a Multi-Picklist but that would require you to update the list of users whenever new users are added or users are deleted.
Sincerely,
Boris Krutiy - Clarizen Success