Folks, are there GenAI tools that can be used like ChapGPT prompt? Basically, chapgpt seems to now require login and i don't want the thing to profile me. I'd rather train a foss tool.

you are viewing a single comment's thread
view the rest of the comments

[–] HoleSailor@feddit.org 1 points 3 days ago* (last edited 3 days ago) (1 children)

For Android, there are plenty of local AI clients such as ChatterUI, PocketPal etc. Just download a suitable gguf model from huggingface and use it. If you have 8GB+ RAM, you can easily run 3B models.

Edit: Try to find iMatrix quantized gguf models. They preserve better quality in in smaller size and runs bit faster.

[–] trilobite@lemmy.ml 1 points 1 day ago (1 children)

None of these are on fdroid. Only Ollama chatta is there but was updated 16 months ago. Hugginface looks interesting. Are the model you download from there safe?

[–] HoleSailor@feddit.org 1 points 21 hours ago* (last edited 21 hours ago)

I use ChatterUI (available on Github) because I found it faster and smoother than the rest of the clients available for Android.

Yes, the gguf models on Huggingface are totally safe. They will run locally in your phone. You don't need Internet connection to run that model. So, it is safe. No data will ever leave your device.

Edit: There is only one client available on f-droid: Maid But it never worked in my device, unfortunately.