Women-Only Restaurant Where Men Are Not Allowed

 Is it wrong to prevent an entire sector of the population from going to an establishment based on a factor they cannot control? What may seem like an unfairly exclusive establishment (especially if it was the other way around).