"Eh, no". There are tons of actual patterns in mathematics, we didn't invent the "laws of physics" we just slapped a framework on top for better understanding. Math isn't a human invention, it's our interpretation of how things work, and at the base of it all there are laws that govern "how things work" (even if we haven't fully discovered all of them), it isn't just randomness that we're trying to apply patterns to.

Using your example of pi, calling it "chaos" is disingenuous, because it's a single constant that has a massive number of applications. That's not random or chaotic at all.