Filter out Specific Users in Colleague search

Admin would like the option to “opt-out” particular Users or have the option to prevent a group of users from a group or specific users from being viewed/selected in Colleague Search.