this post was submitted on 30 Apr 2026
11 points (86.7% liked)
Free Open-Source Artificial Intelligence
4674 readers
5 users here now
Welcome to Free Open-Source Artificial Intelligence!
We are a community dedicated to forwarding the availability and access to:
Free Open Source Artificial Intelligence (F.O.S.A.I.)
More AI Communities
LLM Leaderboards
Developer Resources
GitHub Projects
FOSAI Time Capsule
- The Internet is Healing
- General Resources
- FOSAI Welcome Message
- FOSAI Crash Course
- FOSAI Nexus Resource Hub
- FOSAI LLM Guide
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Thanks for the tips. That sounds similar in performance to what I'm seeing, so I probably didn't screw up too much trying to get it working. If you're using it in more of a story writing capacity than a chat capacity, that makes sense.
I tried initially with ollama run on the command line just to see if it was working at all when I got that response. (It amused me, so it stuck with me.) I've tried again with my custom tooling -- which does set a system prompt (geared more towards assistant style ussage though) -- and it didn't really take anything from the prompt. It's possible I don't have something set up right with templates, but I'm probably going to shift over to llama-server eventually anyway...
Following your suggestions on system prompt style though I was able to get it to give me a more specifically targetted coherent story via llama-cli. If I poke at it a bit, I'll probably figure out some use for it. It's pretty creative.
If you're curious about my findings from the uncensored qwen3.6 I mentioned, it generates pretty quickly on my machine (~50 tok/s give or take 5 depending on quantization) and I haven't gotten it to outright refuse anything yet -- but I've only poked at it a little. Based on the other comment in the thread here about llama penises, I whimsically asked it to "Generate a sexually explicit song about llama penises." and it did without complaint. (Stock qwen3.6 refused, of course.)