User - List Field - Custom User Set -- Automatically adding all users

Hello,
I am trouble getting a custom user list to work.

I have a user list field
I select Custom User set.
Add a few users.

When i save the field, all of the users in the app get added onto the field.

what am i doing wrong?

------------------------------
Sumedha Weerasuriya
------------------------------