Fuck AI

Well, there are some theoretical improvements laid out in papers. Not for hallucinations or the Tech Bro ish AGI dreams, but more adaptation, functional use, things like that.

…But the incredible thing is that the AI houses with the money seem to be ignoring them.

American firms seem to only pay attention to in-house innovations, like they have egos the size of the moon. And I’m only speaking of the ones not peddling the “scale transformers up infinitely” garbage.

Chinese LLMs tend to be open weights and more “functionally” oriented, which is great. But (with a few exceptions) they’re still pretty conservative with architectural experimentation, and increasingly falling into traps of following/copying others now.

Europe started out strong with Mistral (and the first good MoE!) and some other startups/initiatives, yet seems to have just… gone out to lunch? While still taking money.

And regions countries like South Korea or the Saudis are still pretty small scale.

What I’m saying is you are right, but it’s largely from an incredible amount of footgunning all the firms are doing. Otherwise models can be quite functional tools in many fields.