That does make intuitive sense, but archeology shows otherwise. There was a much bigger diversity of gender roles and relationship structures/child rearing systems, including in agricultural societies.

The modern almost universal ideal of romantic monogamous nuclear relationships was born from romantic (as in the movement) puritan petit bourgeois ideals in the 19th century.

Working class women during the medieval age for example, worked and lived outside the home, had affairs etc. This changed around the 18th century with the hegemony of the bourgeoisie and working class mirroring of their ideals.

Basically while it’s true that patriarchal strictly dichotomous societies existed for as long as we can tell, And that they have prevailed and “won out”. But doesn’t mean they are the norm for humanity. Their universality is extremely recent.