I would think that to make these assignments more dynamic the relationships would be like this::
Site >> has many >> Assignments
Employee >> has many >> Assignments
Organization >> has many >> Assignments
This will allow more dynamic selections of Organizations to Sites, Sites to Organizations, Employees to both Sites and Organizations all via the many-to-many Assignments table.