Not necessarily. We were a young family that had to move quite a bit for my job. We made due with apartments, but we preferred renting a house. We were in no position to buy, and we knew we were only in the area short term, so we appreciated house rentals.

Honest people with a second or third home for rent aren't doing any harm.

How do you answer that question honestly though? Say I've got enough liquid cash/ income to buy a second home, if I decide to just sit on this money or throw it in the stock market, does it magically make the family of four able to afford it? No, the house remains the same price, the family has the same amount of money, and the seller moves to the next buyer and sells it to them instead of me.

If anything I'd rather my landlord be someone who owns 2 or 3 homes and rents them than a huge real estate company

In healthy system they should be able to afford to build it.