13
Gemma 2B vs Phi-2 (lemmy.world)

[-] acec@lemmy.world 12 points 8 months ago

Can we say genocide already?

45
why reddit? (lemmy.world)
submitted 11 months ago by acec@lemmy.world to c/localllama@sh.itjust.works

I don't get why a group of users that are willing to run their own LLMs locally and do not want to relay on centralized corporations like openAI or google prefer to discuss using a centralized site like Reddit

7
[-] acec@lemmy.world 2 points 1 year ago

Decent enough for a model 50 times smaller than ChatGPT. I use orca_mini_3b.

[-] acec@lemmy.world 23 points 1 year ago

Compile llama.cpp, download a small GGML LLM model and you will have a quite intelligent assiatant running into your phone.

acec

joined 1 year ago