Rejecting realms based on calling client