Not a perfect system but look into Land Trusts in your areas. Its a way for people to get affordable homes. In Portland we have one called Proud Ground. Basically the trust owns the land and you buy the home. They dont legally get to tell you wnat to do though on said land. They arent there to micromanage like an HAO. They just make it affordable this way. When you eventually sell the home you sell back into the program for other low income families and get 25% of the market value as well as any repairs you made. You can also choose to keep it and pass it down in the family / give it to family if you want to upgrade someday.
This is what my family did. Its not going to fix the housing crisis but I wish more programs like this existed...oh.. and put a cap on how many homes a corporation or entity can buy! No homes should be sitting open in a housing crisis!
P.S. Look into IDA programs too for the down payment! Oregon also has that available and its how we saved for the down payment. Our home is 3bd 2bth in a major city and we only paid 199k for it and our down payment was mostly IDA grant money.