this post was submitted on 24 Jun 2026
113 points (83.4% liked)

Selfhosted

60409 readers
297 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

Detailed Rules Post

  1. Be civil.

  2. No spam.

  3. Posts are to be related to self-hosting.

  4. Don't duplicate the full text of your blog or readme if you're providing a link.

  5. Submission headline should match the article title.

  6. No trolling.

  7. Promotion posts require active participation, with an account that is at least 30 days old. F/LOSS without a paywall has exceptions, with requirements. See the rules link for details.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 3 years ago
MODERATORS
 

Do you host your own ML / AI / LLM? What do you use, and what do you use it for?

you are viewing a single comment's thread
view the rest of the comments
[–] realitaetsverlust@piefed.zip 3 points 1 week ago (1 children)

Jup. Ollama and OpenWebUI is a great stack to tinker with some LLM models. They're kinda useful for aggregating large datasets, translations, frontend development and gathering relevant sources for me to read into. Also, Qwen has been amazing in understanding frameworks without documentation and writing one for me. I had to use some self-developed PHP framework for a task once and without qwen, I would've taken probably two more weeks to get the task done.

MiniCPM has also been REALLY good at image detection, describing it as accurately as possible, feeding it into qwen who then searches what the object could be and returning the result. I always liked google lense and that stack gave me a TEMU-Version of google lense that isn't quite as reliable, but definitely very useful.

[–] SuspiciousCarrot78@aussie.zone 1 points 1 week ago (1 children)

This sounds like an excellent use case and I don't know why you were downvoted.

[–] realitaetsverlust@piefed.zip 1 points 1 week ago (1 children)

Because AI bad I guess. I'm not expecting sane behavior on lemmy when it comes to AI or capitalism lmao

[–] SuspiciousCarrot78@aussie.zone 1 points 1 week ago* (last edited 1 week ago)

Probably. I wish Lemmy would remove up / down votes entirely. I might ask our lovely new mod if that's possible.

The like / dislike button has been a curse since invented.

https://www.theguardian.com/technology/2017/oct/05/smartphone-addiction-silicon-valley-dystopia

EDIT: ah - I can hide em on my end. Not as good but it will do