Local LLMs, I'm surprised no one brought that up yet. I've got an old GPU in my server, and I'm running some local models with openweb-ui for use in the browser and Maid for an Android app to connect to it.
this post was submitted on 03 May 2025
109 points (95.8% liked)
Selfhosted
46594 readers
1088 users here now
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.
Rules:
-
Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
-
No spam posting.
-
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.
-
Don't duplicate the full text of your blog or github here. Just post the link for folks to click.
-
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
-
No trolling.
Resources:
- selfh.st Newsletter and index of selfhosted software and apps
- awesome-selfhosted software
- awesome-sysadmin resources
- Self-Hosted Podcast from Jupiter Broadcasting
Any issues on the community? Report it using the report flag.
Questions? DM the mods!
founded 2 years ago
MODERATORS
You’re a brave one admitting that on here. Don’t you know LLM’s are pure evil? You might as well be torturing children!
Ais fine as a tool, trying to replace workers and artists while blatantly ripping stuff off is annoying, it can be a timesaver or just helpful for searching through your own docs/files
If you agree it’s a time saver, then you agree it makes workers more efficient. You now have a team of 5 doing the work of a team of 6. From a business perspective it’s idiotic to have more people than you need to, so someone would be let go from that team.
I personally don’t see any issue with this, as it’s been happening for the existence of humanity.
Tools are constantly improving that make us more efficient.
Most of people’s issue with AI is more an issue with greedy humans, and not the technology itself. Lord knows that new team of 5 is not getting the collective pay as the previous team of 6.
I think most people on here are reasonable, and I think local LLMs are reasonable.
The race to AGI and companies trying to shove "AI" into everything is kind of insane, but it's hard to deny LLMs are useful and running them locally you dont have privacy concerns.
Interesting, this has not been my experience. Most people on here seem to treat AI as completely black and white, with zero shades of grey.
I see a mix, don't get me wrong, Lemmy is definitely opinionated lol, but I don't think it's quite black and white.
Also, generally, I'm not going to not share my thoughts or opinions because I'm afraid of people that don't understand nuance, sometimes I don't feel like dealing with it, but I'm going to share my opinion most of the time.
OP asked what you self host that isn't media, self hosted LLMs is something I find very useful and I didn't see mentioned. Home assistant, pihole, etc, all great answers... But those were already mentioned.
I still have positive upvotes on that comment, and no one has flamed me yet, but we will see.
I’ll give my recommendation to local LLMs as well. I have a 1060 super that I bought years ago in 2019 and it’s just big enough to do some very basic auto completion within visual studio. I love it. I wouldn’t trust it to write an entire program on its own, but when I have hit a mental block and need a rough estimate of how to use a library or how I can arrange some code, it gives me enough inspiration to get through that hump.
Ya exactly! Or just sanity checking if you understand how something works, I use it a lot for that, or trying to fill in knowledge gaps.
Also qwen3 is out, check that out, it might fit on a 1060.
I self-host web apps I write myself? ¯\(ツ)/¯
I'm just starting to get into this myself. I made one so my family can easily check the status of my media server and send a movie, show, or music request to sonarr, radarr, and soularr(WIP) so they don't have to bug me when they want something and it also helps them to feel they have more agency in the process. It's pretty useful for me as well to be able to easily download things instead on the go instead of keeping a neverending list.
What kind of apps do you write?
searxng an matrix both on a vps an public an everything else i host local an are not on the web
Depends on what you consider self-hosted. Web applications I use over LAN include Home Assistant, NextRSS, Syncthing, cockpit-machines (VM host), and media stuff (Jellyfin, Kavita, etc). Without web UI, I also run servers for NFS, SMB, and Joplin sync. Nothing but a Wireguard VPN is public-facing; I generally only use it for SSH and file transfer but can access anything else through it.
I've had NextCloud running for a year or two but honestly don't see much point and will probably uninstall it.
I've been planning to someday also try out Immich (photo sync), Radicale (calendar), ntfy.sh, paperless-ngx, ArchiveBox (web archive), Tube Archivist (YouTube archive), and Frigate NVR.
SearXNG, Forgejo, Linkwarden, Vaultwarden, copyparty, all the Servarr apps, qBittorrent and SABnzbd for downloads, Syncthing, Mastodon, and all the various containers like databases and other tools that support the aforementioned.
Foundry VTT (I know it's technically for a game but it's technically a virtual tabletop and not a game itself)
AI Chatbots for tech support
I technically self-host an image generation AI through my main home PC, but that's made less accessable and only on when I specifically demand it via ssh lol
Occasionally I'll throw a temp website up for local events for like event schedules or whatever, an easily accessable and editable html file or whatever
I see mention of Foundry, I upvote. My friends and I have been using it for a couple years and still find new ways to be impressed by it.
I just started porting a DnD Beyond campaign into it and using it to store homebrew world info for a future game, but so far it's been basically everything I ever wanted from Roll20 or DDB, but self-hosted and they give you access to the code so you can just... Code in features you want
Thinking about pirating the FFXIV TTRPG when someone puts it up and making it in Foundry if it's not already done by someone smarter eventually lol
Headscale
Matrix server (conduwuit, soon to be tuwunel)
Matrix bridges (slack, discord, whatsapp)
Adguard
Pihole
Findmydevice
Redlib
Linkwarden
Forgejo
Ntfy
Molly socket
Home assistant
Uptime Kuma
There's probably more that I'm forgetting lol
Adguard
Pihole
More adblockers for the ad-blocking god!
Lol, when I moved the most recent pihole version had just got released so I wanted to check it out. I have pihole service my IoT network and 3 adguard->unbound instances setup for my main network for fallbacks 🤣.
But yeah I hate ads/trackers with a burning passion as you can see hahaha
You can selfhost find my device? Do you have a link to that project?
Yep you can self-host findmydevice anywhere. Personally, I deployed it on fly.io as I don't expose my local network to the internet for security reasons
+1 For hass.
Baikal for calendar, todo and contact syncing
Forgejo for version control
Silverbullet for markdown notes
FreshRSS for aggregated news
Linkding for bookmarks
- Gitlab (version control)
- Bookstack (wiki)
- Joplin (not a webapp, but sync server)
- Semaphore (does all of my infra updating via Ansible)
- Uptime-Kuma (monitoring/alerting)
Been thinking about adding NextCloud mostly for the Google Docs/MS Office replacement at some point.
But honestly most of my stuff is just for me, my family prefers to to use whatever commercial thing is out there. So I tend to limit things to infrastructure type things that are of personal interest to me alone.
Gitlab
This guy has a lot of memory in his server
It is allotted 16GB out of the 62GB total that the host has. Which is the amount their docs call for in a 20 RPS or 1000 user scenario. Since I am the only one doing any commits or pulls, it does fine.
Does take its sweet time to reboot though. 😆
Wow, I would never considering allocating so much memory to a single service I run at home.
It is all running in a Proxmox cluster. 2 nodes have 62GB and one has 32GB. So while it is a good chunk. Not enough to bottleneck available RAM for other things in the cluster.
I randomly think about something I want, and then usually find it here. Used to be a GitHub repo, but it got so popular and useful they got a nice site with search and all, now.
https://awesome-selfhosted.net/
I don't have as much running anymore outside media/games, but I do still run Stirling PDF as an Acrobat Pro alternative.
- Forgejo - git hosting
- actual budget - spending tracking mostly
- Vaultwarden
- home assistant - still configuring
I like to seed legal torrents for archival purposes. And run a comic server for syncing with my kobo ereader . Oh and rss
I keep everything documented, along with my infrastructure as code stuff. Briefly:
- Nextcloud
- Vaultwarden
- Miniflux
- My blog
- Takahe (a multi-domain) ActivityPub server
- My health tracker CRUD data entry
- https://alexpdp7.github.io/selfhostwatch/
- Grafana (for health stats and monitoring data from Nagios)
- Nagios
- FreeIPA/Ipsilon (SSO)
edit: plus a few things that do not have a web UI.
All these. I just added calibre web and may phase out Kavita.
What interface is that, it looks great!
That's TrueNas. It can run docker compose files so I'm abusing the crap out of what it's supposed to do haha.
load more comments
(1 replies)
load more comments
(4 replies)
- Immich backs up photos from my phone and camera with tagging and search
- Archivebox is like a personal internet archive, I use it to save youtube videos and important memes
- Homeassistant does home automation stuff, currently I only use it to turn the speakers on/off with the tv
- Forgejo is a git host like Github, and can regularly pull external repositories to keep a personal mirror
- Actual budget is a budgeting app, nice for tracking expenses across multiple accounts
You made me actually check out Immich and I love the tagging feature. That makes it feel much more like a photo library and less like just a giant file storage solution that happens to store photos.
Immich is really good actually. Completely replaced Google Photos for me.
load more comments
(8 replies)
view more: next ›