Free Open-Source Artificial Intelligence

4690 readers

31 users here now

Welcome to Free Open-Source Artificial Intelligence!

We are a community dedicated to forwarding the availability and access to:

Free Open Source Artificial Intelligence (F.O.S.A.I.)

More AI Communities

LLM Leaderboards

Developer Resources

GitHub Projects

GitHub Stars

FOSAI Time Capsule

founded 3 years ago

MODERATORS

Blaed@lemmy.world

fosai@lemmy.world

LLM Assistant for Markdown Documents (quokk.au)

submitted 1 month ago by fizzle@quokk.au to c/fosai@lemmy.world

10 comments fedilink hide all child comments

I keep a lot of notes in markdown files, and I'd like an LLM to assist.

I regularly use Open WebUI with with inference routed through huggingface. Open WebUI kind of has this functionality like you can upload a markdown file and prompt it to improve it in whatever way, but of course that's a fairly clunky workflow.

I really want something built into the editor, that can use RAG to consider other files in context.

I also don't want to be locked in to a specific LLM or provider, I'd like to be able to link it to OpenRouter or similar.

you are viewing a single comment's thread
view the rest of the comments

[–] fizzle@quokk.au 1 points 1 month ago

you are looking fir a markdown editor which has a chat window on the side which can look at other files to assist in writing.

Yes, although I'm interested in what other solutions might be around.

I use a variety of editors. Whichever suits my mood in a given moment. Sometimes helix which is a TUI, sometimes gnome's text editor, sometimes zettlr which is a more "zettelkasten" type knowledge base manager. I'm flexible. If there was a text editor that had this type of functionality built in then that's what I'd use for tasks where I wanted this type of assistance. I don't care about vim short cuts.

I appreciate your proposing a solution. It still feels like there's a yawning chasm in my knowledge. As in, what platform or software can I use to implement tools like you propose? I haven't been able to figure out how to get open webui to provide that sort of functionality, although I suspect that it can.

I think I'm asking, what is the software that connects my selection of markdown files to the LLM. I know you can upload a bunch of text files to open webui but you can't edit in place. it would be like upload edit download upload edit download upload ad nauseum.