AI

5637 readers

10 users here now

Artificial intelligence (AI) is intelligence demonstrated by machines, unlike the natural intelligence displayed by humans and animals, which involves consciousness and emotionality. The distinction between the former and the latter categories is often revealed by the acronym chosen.

founded 4 years ago

How do you use AI when you need to but avoid giving it any data or anything that violates your privacy? (lemmy.world)

submitted 1 week ago by wowwoweowza@lemmy.world to c/artificial_intel@lemmy.ml

10 comments fedilink hide all child comments

Guess it’s all in the subject. I’ve found some implementations of AI practical but it’s always asking for more data more everything. Just curious about how others use AI as carefully as possible.

you are viewing a single comment's thread
view the rest of the comments

[–] SmokeyDope@piefed.social 2 points 4 days ago (1 children)

Use a local model, learn some toolcalling and have it retrieve factual answers from a database like wolfram alpha if needed. . We have a community over at c/localllama@sh.itjust.works all about local models. if your not very techy I recommend starting with a simple llamafile which is a one click executable EXE that packages engine and model together in a single file.

Then move on to a real local model engine like kobold.cpp running a quantized model that fits in your computer especially if you have a graphics card and want to offload via CUDA or Vulcan. Feel free to reply/message me if you need further clarification/guidance

https://github.com/mozilla-ai/llamafile

https://github.com/LostRuins/koboldcpp

I would start with a 7b q4km quant see if your system can run that.

[–] wowwoweowza@lemmy.world 2 points 4 days ago

Thank you so much. My work schedule lightens for a few days in December and this is top of my to do.

I’m actually quite excited to learn more about local models so your guidance is richly appreciated and I will surely check out the community you mention here.