I use pi, llama.app links to it. super minimal, easy to extend.
this post was submitted on 29 Apr 2026
14 points (93.8% liked)
LocalLLaMA
4782 readers
11 users here now
Welcome to LocalLLaMA! Here we discuss running and developing machine learning models at home. Lets explore cutting edge open source neural network technology together.
Get support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.
As ambassadors of the self-hosting machine learning community, we strive to support each other and share our enthusiasm in a positive constructive way.
Rules:
Rule 1 - No harassment or personal character attacks of community members. I.E no namecalling, no generalizing entire groups of people that make up our community, no baseless personal insults.
Rule 2 - No comparing artificial intelligence/machine learning models to cryptocurrency. I.E no comparing the usefulness of models to that of NFTs, no comparing the resource usage required to train a model is anything close to maintaining a blockchain/ mining for crypto, no implying its just a fad/bubble that will leave people with nothing of value when it burst.
Rule 3 - No comparing artificial intelligence/machine learning to simple text prediction algorithms. I.E statements such as "llms are basically just simple text predictions like what your phone keyboard autocorrect uses, and they're still using the same algorithms since <over 10 years ago>.
Rule 4 - No implying that models are devoid of purpose or potential for enriching peoples lives.
founded 3 years ago
MODERATORS
You can use Cline with a local AI. It doesn't work great for enterprise level stuff because the number of tokens quickly swamps my MacBook, but qwen code can easily handle bash/ Python scripts and the like. Then you can use .clinerules to shape the agents but it's all mostly vibe from there on out
At work, we use a highly structured folder of agent prompts and infrastructure information with Claude. Because it's so highly structured it feels more like intentional code/config but I couldn't quantify any improvement metric at this time. There might be, but it would be premature to suggest you'd see any improvement over very be prompts.
There are a few lists like this one: https://github.com/alvinreal/awesome-opensource-ai
Not sure what your needs are. There is a large variety of agentic frameworks listed. From things like LangChain to build your own to HermesAgent or Openclaw variants that are supposed to be more "secure".
Personally I'm testing Agent Zero which runs in a docker container and is meant to be an orchestrator of multiple subagents.
Thanks. Maybe Agent Zero is a bit too close to the "usual" security model for my liking. Seems they also tell me to run it isolated and not connect it to private data and production systems... But that's kind of what I want. I'd like it to screen my email inbox or move the remaining spam mails to the spam folder. But I thought there maybe was some sane approach where a human programmed the email adapter of it. And I can just configure the agent to stick with read permissions only.
Thanks for the other link. From reading the list, I think crewAI and smolagents are closest to what I want. I mean I don't have an exact use case. I just figured since everyone and their grandma supposedly has AI agents these days. And AI is supposed to my life better, I'd try it. Idk. Let it sift trough my email inbox. Some online RSS feeds and the changelogs of some open-source projects I follow and alert me if there's something interesting. Or if there's something going on in a pull request I was part of... Maybe it can help with some other things. Or be a FAQ bot for all the knowledge I stored on my computer... Or generate a cat picture and send it to me via chat at lunchtime to brighten up my day. Connect to my Home Assistant and ping me before I leave the house if the train is delayed, it's icy conditions on the road. That's roughly what could be my needs.
But I want something more grounded than OpenClaw. It's probably easy to build in some permission system and come up with separate agents for tasks, so the email agent can't blackmail me with information from my knowledgebase, or delete the inbox. And sure I could use LangChain. That'd do it. But I've tried, and that's just a lot of work. I'll end up coding all the workflows myself. Figure out the prompts or steal them from another project. Reinvent how planning and subdividing tasks works... Copy lots of boilerplate code to start a vector database and then do RAG. Memory, skills. I'll have to write all the email, chat, RSS, webcrawler integrations myself. A scheduler, background tasks. Then code an entire UI because what they have is more for testing and very straightforward chatbots. And it just escalates to a 100h+ Python project. For what I think must have been written several times already?!
Totally reletable, I actually want the same functions. I will stick to something more conservative at the moment to test and also because it is relevant for my work.
AgentZero has builtin connectors to Email, Telegram and WhatsApp. You can install plugins for Matrix or Discord. Not sure about the security model as I do not use these currently.
However, it also has a secrets store that replaces secrets in tool calls locally. I use it for SSH access to another machine.
The a0 connector can be used to link it to your PC locally for projects that require file acces, etc.
In terms of automation n8n is the closest you'll ever get that is at least partially FOSS.
But for client based I'm having good experience with Goose https://github.com/aaif-goose/goose
The project recently moved to the AI arm of the Linux foundation.
It's a mix of terminal helper and agent orchestrator. I'm not yet too deep but the mix of recipes and skills seems to work pretty well!
Sorry I'm talking out of my butt but a buddy introduced me to openclaw yesterday and been meaning to look into it. No idea what it all is just that it seemed neat
Yeah, OpenClaw is the lunatic approach I mentioned. It's hilarious. And a nice idea. But it might also delete all your data, write a nasty email to your boss/wife, leave you with a $200 a month API bill... It can also do a lot of things and it is fun. Especially reading what crazy things are going on in that ecosystem. But it's not what I'm looking for, right now 😅