214
If open weight models are the future, U.S. AI companies are going to have a hard time
(www.fastcompany.com)
This is a most excellent place for technology news and articles.
We even got open weight models that's 27B + 1-bit (and it still has good performance)
Bonsai? Or whatever it’s called? It’s a con, so far; it’s not better than smaller models quantized to 3-4 bits.
I love, love the idea of bitnet, but it only seems to work with models trained from scratch, which no one has done at scale yet.
yeah bonsai