this post was submitted on 09 Jul 2025
41 points (83.6% liked)

Memes

4349 readers
104 users here now

Good memes, bad memes, unite towards a united front.

founded 5 years ago
MODERATORS
 
you are viewing a single comment's thread
view the rest of the comments
[–] Malkhodr@lemmygrad.ml 10 points 2 days ago (1 children)

May I ask if you could point to a compiled list of them for the uninitiated and tech illiterate?

[–] yogthos@lemmygrad.ml 16 points 2 days ago (1 children)
[–] FuckBigTech347@lemmygrad.ml 3 points 1 day ago (1 children)

There is a project I've discovered recently which is similar to GPT4All, except you can throw multiple GPUs at the workloads (and yes it can use Vulkan): https://github.com/LostRuins/koboldcpp

I haven't messed much with it but it builds and works fine on Linux. The only thing I don't like is that the source tree has a bunch of Windows binaries in it.

[–] yogthos@lemmygrad.ml 3 points 1 day ago

Oh nifty, another handy one is Jan, it can even use MCP with the beta version https://jan.ai/