this post was submitted on 12 Oct 2026
78 points (83.6% liked)

Linux

15250 readers
437 users here now

A community for everything relating to the GNU/Linux operating system (except the memes!)

Also, check out:

Original icon base courtesy of lewing@isc.tamu.edu and The GIMP

founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] mindbleach@sh.itjust.works 1 points 1 week ago

I'd definitely like someone to champion an open-weights model under 32 GB. But part of that desire is - I'm not sure they're there, yet. Local models are only a few months behind, but hoo boy, the last few months have been big.

Coding models could be tiny, but distilled versions keep preserving pop-culture knowledge and world history, when reasoning through C++ requires essentially none of that. It needs the tokenization to recognize why a comment begins "Jesus Christ." It's fine for "treat the hash like Lot's wife" to go completely over its head. Keep the weights that know a regex for e-mails, not the capitol of Florida. If it speaks a dead language I want it to be Algol.