Sure there's people out there who will avoid you based on looks but usually though it's something else. If you're confident, kind, and properly socializing, then looks often don't matter.

The thing about looks that matter is how you present yourself. Keep up the hygiene, keep your clothes cleaned, and just present your best self as a person.

I say this as a fat dude who hasn't bought new clothes in 10+ years and even then bought what I liked not what was in style. I still do just fine. For us men, our look is in our attitude.

You seem like you really want to find the answer to getting out there but you're getting in your own head. Just let it slide, go have fun, don't focus on other people, don't worry about past slip ups once you've learned from them, maybe find a mentor. You do that, and the rest will happen. It just takes time and patience.