this post was submitted on 08 Jan 2026
60 points (95.5% liked)
Privacy
48505 readers
685 users here now
A place to discuss privacy and freedom in the digital world.
Privacy has become a very important issue in modern society, with companies and governments constantly abusing their power, more and more people are waking up to the importance of digital privacy.
In this community everyone is welcome to post links and discuss topics related to privacy.
Some Rules
- Posting a link to a website containing tracking isn't great, if contents of the website are behind a paywall maybe copy them into the post
- Don't promote proprietary software
- Try to keep things on topic
- If you have a question, please try searching for previous discussions, maybe it has already been answered
- Reposts are fine, but should have at least a couple of weeks in between so that the post can reach a new audience
- Be nice :)
Related communities
much thanks to @gary_host_laptop for the logo design :)
founded 6 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Thats awesome! I was going to add some sort of AI to my proxmox homelab for researching but I figured the risk of halloucination was too high, and I thought that the only way to fix this was getting a bigger model. But thid seams like a really good setup (if I can actually figure out how to implement it.) And I wont need to upgrade my gpu!
Althogh I only have one ai suitable gpu (I have a gtx 1660 6gb in my homelab which is really only suitable for movie transcoding.) I have a 3060 12gb that I use in my gaming pc I was thinking I could setup some kind of wol system that boots the pc and sets up the ai software on that. Maybe my homelab hosts openwebui and when I send a queory it prompts my gaming pc to wake up and do the ai crunching.
I have a 12 gig gpu that I dont use for most of the time, might as well put it to work doing something. And even second hand ddr4 memory has gotten so expensive I'd rather not have to upgrade my homelab.
What is your main use case for this anyway? Do you use it for researching? Thats what I would mainly use it for, but also finding things in my obsidian volt.
What stage have you actually gotten to?
I do like the idea of this all though. I should really get into undervolting/overclocking my stuff, there is really no reason not to I could either gain performance or longevity or both!
Also I hate that the stock fans on cpu's are so garbage. Luckily arctic fans are really cheap and quiet. Noctua is great but i'd sooner buy a budget aio than a single noctua fan lol.
Oh I didn't realise you were going to release it! I was just going to try and setup a simplified version myself, that's really cool. Don't worry I'm patient and I will be too busy this year to implement anything for myself anyway, but I too (with my likely getting diagnosed soon adhd brain) share your enthusiasm for a way to implement an AI that collects information for you without lying.
I just saw it, this is really cool I hope I get around to this in the not too distant future.