Privacy
A place to discuss privacy and freedom in the digital world.
Privacy has become a very important issue in modern society, with companies and governments constantly abusing their power, more and more people are waking up to the importance of digital privacy.
In this community everyone is welcome to post links and discuss topics related to privacy.
Some Rules
- Posting a link to a website containing tracking isn't great, if contents of the website are behind a paywall maybe copy them into the post
- Don't promote proprietary software
- Try to keep things on topic
- If you have a question, please try searching for previous discussions, maybe it has already been answered
- Reposts are fine, but should have at least a couple of weeks in between so that the post can reach a new audience
- Be nice :)
Related communities
much thanks to @gary_host_laptop for the logo design :)
"If something is free, you are the product"
If you're not providing your own compute power or your money (and you're not safe even if you pay most providers), expect the payment to come from your personal information or conversation contents being harvested. I'm not sure what magical service you're expecting that doesn't involve self-hosting for truly private conversations - you're just accessing someone else's machine if you're not hosting it yourself, and you're at their mercy.
What's "the privilege of running a local model"? If it's on a computer, it's not much of a privilege, gpt4all can get up and running in a minute. For mobile phones RAM is more of an issue.
I do not have a good enough internet connection to download local modals (Very unstable and slow). Downloading even an OS ISO file is not possible for me and i download them via friends. I don't think anyone would accept my request to download a 10GB+ file
Paid commercial LLM providers already profit off of inputs more than outputs, so I wouldn't trust any free cloud offering to be private. If you really want free and private, self-hosted is the only way to go
OpenRouter has some decently powerful free-to-use models, but I'm afraid as far as LLMs go 'free', 'good', and 'private' are going to be pretty mutually exclusive if you can't run one locally.
Seems like a cool product. I will check it out
I use Jan. It's really good. A minimal install needs around 10GB of space and you can use it offline. The 'jan nano' model works faster than I can read in most cases.
There are a few AI models that are in this category, and I really liked Jan when I tested it out.
Cool, which ones do you recommend? Yeah, I found it really straightforward and pleasant to get started.
- LocalAI
- Ollama
The Qwen models that you can run with llama.cpp (Jan's main backend) are quite brilliant for their size
Isn't duck.ai private? At least they say that...
No.
The hardware needed to host even just a full size gpt3 costs tens of thousands of dollars, requires high current or high voltage circuits not usually accessible in residential homes and will actually use multiple thousands of watts of power.
If someone is giving access to such an expensive, power hungry industrial system for free they’re either doing it to learn from the inputs (not private) or don’t have a commercially viable system (not good).
nano-gpt.com
Bruv it looks like it was made by a 10 year old 😭
Venice.ai is an uncensored model which is free and needs no account. Not sure if it's truly private though.