After you create a port set, you must bind the port set to an igroup so the host knows which FC ports to access.
If you do not bind an igroup to a port set, and you map a LUN to the igroup, then the initiators in the igroup can access the LUN on any port on the storage system.