this post was submitted on 28 Nov 2023
13 points (93.3% liked)

LocalLLaMA

2249 readers
1 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 1 year ago
MODERATORS
SkySyrup@sh.itjust.works
pax@sh.itjust.works
noneabove1182@sh.itjust.works
13
I'm having a fantastic time with this model. (huggingface.co)
submitted 11 months ago by Stopwatch8200@lemmynsfw.com to c/localllama@sh.itjust.works
6 comments fedilink hide all child comments
 

I've been using TheBlokes Q8 of https://huggingface.co/teknium/OpenHermes-2.5-Mistral-7B, but now this one (https://huggingface.co/Weyaxi/OpenHermes-2.5-neural-chat-7b-v3-1-7B) I think is killing it. Has anyone else tested it?

you are viewing a single comment's thread
view the rest of the comments
[–] MigratingtoLemmy@lemmy.world 2 points 11 months ago

What hardware are you running this off of?