I'd argue that unless your goal is to look good at the gym, there's isn't much need to bother with getting pricier/higher quality clothes. Some of my most comfortable gym shirts cost less than a quarter of my "objectively" higher quality shirts.

Light and breathable gym shirts doesn't cost much and there isn't much comfort to gain by going pricier either. It's mostly about the looks in my experience.