this post was submitted on 18 Aug 2026
75 points (100.0% liked)

technology

24471 readers
87 users here now

On the road to fully automated luxury gay space communism.

Spreading Linux propaganda since 2020

Rules:

founded 6 years ago
MODERATORS
 

No datacenter needed now, just run it on your computer. Anything with 12gb+ of vram can run it comfortably at low quants. If they can come out with a good MOE model it will crush the competition. At this current rate of progress, China will out-compete foreign AI development within a year or two.

you are viewing a single comment's thread
view the rest of the comments
[–] lurkerlady@hexbear.net 5 points 1 month ago* (last edited 1 month ago)

You might like Proton Mail's Lumo project, I find it useful for quicker searches without needing an account, they use open-weights models only. Unsloth with EXA or setting up searxng-mcp is your other best bet, Unsloth has a desktop app now.