Yes, it surely is a situation where this question should be asked, however the question has been asked and "we the people" have decided (and written into law) that in this type of scenarios equality overrides individual freedom.
In particular, it's been decided that in many cases (IIRC it starts to apply if the company has more than 15 employees) any person, male or female, does not have the right to decide what demographics their private company is composed of. That's it. This is the similar to "the right to swing your fist ends at my nose"; there is an inherent conflict between ability to choose demographics in your company and the ability of all demographics to get a fair job, we can't have both. We considered that this is a problem that needs to be solved and that such restrictions are going to be (part of) a solution. We may make different choices in future, but that's the one we currently have.
In particular, it's been decided that in many cases (IIRC it starts to apply if the company has more than 15 employees) any person, male or female, does not have the right to decide what demographics their private company is composed of. That's it. This is the similar to "the right to swing your fist ends at my nose"; there is an inherent conflict between ability to choose demographics in your company and the ability of all demographics to get a fair job, we can't have both. We considered that this is a problem that needs to be solved and that such restrictions are going to be (part of) a solution. We may make different choices in future, but that's the one we currently have.