Ollama - Local LLMs for everyone!

350 readers

4 users here now

A place to discuss Ollama, from basic use, extensions and addons, integrations, and using it in custom code to create agents.

founded 10 months ago

MODERATORS

catty@lemmy.world

How to provide local files for Ollama models to use on replies? (thebrainbin.org)

submitted 5 days ago by Auster@thebrainbin.org to c/Ollama@lemmy.world

2 comments fedilink hide all child comments

How to provide local files for Ollama models to use on replies?

For individual files, apparently #Ollama allows natively from what I could find, but I couldn't understand the instructions. Is there some tutorial I may have missed that explains it in layman's terms?

I also remember someone on the threadiverse posting some tool or plugin for that too, which I'll try looking for again when I'm not busy.

And what about whole directories, would it be possible without converting everything into a single file if the folder has only/mostly TXT files or similar?

Thanks in advance, and aldo thanks for the patience with the newbie questions! "<.<

@Ollama@lemmy.world

you are viewing a single comment's thread
view the rest of the comments

[–] iceberg314@slrpnk.net 2 points 4 days ago (1 children)

You might like Open Web UI or something similar. They have a RAG (retrieval augmented generation) feature where you can upload and embed a whole folder of info and the LLM will search that for additional context before answering your question. Connects right up to ollama.

[–] Auster@thebrainbin.org 1 points 3 days ago

Will take a look. Thanks!