It would be great to somehow communicate to partners that they must be added as a collaborator and they shouldn't make the site on-behalf of their clients using that module on the left.

This is currently only communicated as part of our automated onboarding within .com/partner-portal but we'll try to educate further for the time being.