Clearing out User field for custom user list

This seems like it should be simple and maybe I am just missing something? I found a thread from 2017 that says this isn't possible, and am wondering if it's the same today.

On a user field you can have it populate all your users, or you can select a custom user set. However, you must remove the users from that set one at a time.

Can you simply remove ALL users, then add who you want? Or even remove chunks of users at one time? It's a lot of clicking to remove them all.....

------------------------------
Mike Tamoush
------------------------------