this post was submitted on 02 Jun 2026
-7 points (37.0% liked)
Free Open-Source Artificial Intelligence
4776 readers
15 users here now
Welcome to Free Open-Source Artificial Intelligence!
We are a community dedicated to forwarding the availability and access to:
Free Open Source Artificial Intelligence (F.O.S.A.I.)
More AI Communities
LLM Leaderboards
Developer Resources
GitHub Projects
FOSAI Time Capsule
- The Internet is Healing
- General Resources
- FOSAI Welcome Message
- FOSAI Crash Course
- FOSAI Nexus Resource Hub
- FOSAI LLM Guide
founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Looking at your writing guide for the LLM, I think my advice about changing workflow was right.
Break the problem down into much smaller steps and then have the LLM do editing passes and self-review from multiple perspectives after getting a crappy rough draft back instead of trying to get it to match your style one-shot.
Using something like this to provide context for the scene when generating a rough draft will likely be helpful:
Also, are you dumping in the full PDF of the entire work so far? Try doing a pass to skeletonize it down into an outline -- maybe chapter by chapter or even scene by scene -- along with getting organized about characters by making profile summaries so that the LLM can understand your story in an already partially digested form instead of trying to do everything all together at once with the huge amount of context reading a full story implies. It's probably getting lost in the weeds.
I appreciate the advice help. Idk if I can really get them to work that well. Or feel like giving context every single time I wanna prompt a plan for a chapter or to write it. Summaries miss necessary info as well and the AI can miss context from even shorter stuff I send it. Since I'm trying to have something written for a specific series that definitely needs to be looked up, and locations aren't really that simple honestly.
Could you recommend the best AI's to use on mobile and on free tier to write ? At least one's that are decently capable of following what I had in the style guide. I can still write or fix the rest. My fic averages around 6,500 words a chapter, so preferably I'd like a one capable of write that or at least a scene that's more than 2000 words slightly. I don't mind going scene by scene if at least it's possible to do so as I can at best get two scenes done with Claude if I tried that method but not be able to tell it what's wrong what it missed like for Deepseek, Deepseek can't search at all which is an issue for me.
I only use open weight models on my own hardware, so I can't give recommendations there from personal experience. If you want suggestions on open models though, there are uncensored Qwen and Gemma4 models that are pretty decent when run at higher quants. I use llmfan46's
Qwen3.6-35B-A3B-uncensored-heretic-GGUFas my default and I've just downloadedgemma-4-26B-A4B-it-ultra-uncensored-heretic-GGUFthis past weekend to experiment with. (Gemma4 stock Q4_K_M has usually been annoyingly thick-headed compared to Qwen so I haven't used Gemma4 as much, but the Q8 uncensored is pretty sharp, fast on my hardware, and unlike Qwen doesn't get stuck in loops constantly, so I may switch over to that as my default... Need to evaluate more first though.)The sidebar gives a link-to-a-link to https://aihorde.net/ though -- haven't used it personally, but might be up your alley.