I think generally speaking the whole of Western society (and many other societies in the world) is sexist and misogynist, it's not just judges who are not going to be impartial because of their social values, but everyone: employers, police officers, politicians, doctors, journalists, and so on.
All people, including women, have been acculturated to have unjust and essentialising views about women (and men) - people are more likely to be dismissive to women and not take them seriously; more likely to view women as inherently sexual compared to men; more likely to view women as dishonest or manipulative; more likely to commit violence against women as they are viewed as weak and passive; more likely to pay women less than male employees as women are viewed as less intelligent, serious, or loyal; and so on.
It's not a surprise one in three women in the world have experienced beatings, rape, or other forms of abuse, usually at the hands of someone they know (not from strangers).
I consider this a situation of systemic oppression, and yes - misogynist judges are absolutely part of the problem.
EDIT:
Patriarchy may privilege men in many ways, but it is not just perpetuated by men, nor is it actually a good thing for men. Women participate in their oppression, extreme examples may include GOP U.S. Congress women like Marjorie Taylor Greene, Nancy Mace, or Lauren Boebert - who enable a misogynistic GOP political agenda. But in more mundane ways, women police one another in their femininity and are not different from men in their misogynistic views - I have heard so many stories of women who hate themselves for being women (e.g. JK Rowling).
Meanwhile, men under this state of affairs are viewed as unsafe and suspect, as predators - whether they are actually violent or not. Men should be motivated as anyone else to end the alienation they experience and injustice to both men and women under patriarchy. Too often feminism is thought of in terms of women vs men, as men as the oppressors and women the victims. I think this simplifies the situation in a way that makes potential alliances with men difficult, and makes it harder to acknowledge the way patriarchy actually functions and exists in society.