Thinking like this just works against those of us trying to fight racism. Racism is, at its core founded in a belief that some people are inherently more valuable than others, based on ethnicity/how they look.

A factual statement about a group of people can be true or false, but in order to be racist it must also (explicitly or implicitly) say something about those peoples worth.

Saying "group A has lower IQ than group B" can be factually correct, and part in an analysis into why, and how the differences can be evened out. Saying "group X is dumber than group Y" can also be factually correct, but can be said in a context and with an implication that this makes them less valuable as people. Purely based on the statements themselves you can't tell if either is racist. You need to look at the implications, context, and intentions behind the statement.

One of the horrors of slavery was, in fact, the forced "breeding" of slaves. Even thinking about it makes me feel sick. That doesn't mean the statement "group X was bred differently from group Y" inherently racist. The racism comes in if that statement is said with the implication that the people in question were subhuman, or otherwise less (or more) valuable as people.

A good example that another commenter mentioned is the Ashkenazi Jews, which systematically eradicated a genetic disorder by tracking who should not have children. Saying "they bred the disease out of the population" may be imprecise and a poor choice of words, but it is not racist. It is a factually correct (albeit poorly phrased) statement about an impressive medical feat that has (presumably) improved a lot of lives.

In order to fight racism you need to be more nuanced than what you are being when you say that "statement X is racist, regardless of the intention behind it". A statement being poorly phrased can lead to it being misinterpreted, not to it being racist.