this post was submitted on 06 Aug 2026
44 points (97.8% liked)
technology
24444 readers
139 users here now
On the road to fully automated luxury gay space communism.
Spreading Linux propaganda since 2020
- Ways to run Microsoft/Adobe and more on Linux
- The Ultimate FOSS Guide For Android
- Great libre software on Windows
- Hey you, the lib still using Chrome. Read this post!
Rules:
- 1. Obviously abide by the sitewide code of conduct. Bigotry will be met with an immediate ban
- 2. This community is about technology. Offtopic is permitted as long as it is kept in the comment sections
- 3. Although this is not /c/libre, FOSS related posting is tolerated, and even welcome in the case of effort posts
- 4. We believe technology should be liberating. As such, avoid promoting proprietary and/or bourgeois technology
- 5. Explanatory posts to correct the potential mistakes a comrade made in a post of their own are allowed, as long as they remain respectful
- 6. No crypto (Bitcoin, NFT, etc.) speculation, unless it is purely informative and not too cringe
- 7. Absolutely no tech bro shit. If you have a good opinion of Silicon Valley billionaires please manifest yourself so we can ban you.
founded 6 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Just use it offline bro if you can. I do not really use LLMs much lately so IDK, but I prefer gemma4 though. Deepseek distilled to 7 or 8b will probably work fine with mid range relatively recent hardware.
hows gemma 4 treating you lately? the prices on openrouter were worse than deepseek at the time so i never even bothered to try it
Quite efficient to run locally, 26b A4B runs pretty well on a 8GB card at around 10 t/s for me. Excells at tasks like translation but falls short at agentic coding in comparison to Qwen.
Gemma 4 26B A4B: Vision is very imprecise. Reasons forever. If it ever stops reasoning then the answers are usually good for a local model, but it also has surprisingly bad failure cases too. The usual. It's very fast.