this post was submitted on 03 Nov 2025
81 points (100.0% liked)
Apple
1194 readers
2 users here now
There are a couple of community rules in addition to the main instance rules.
All posts must be about Apple
Anything goes as long as it’s about Apple. News about other companies and devices is allowed if it directly relates to Apple.
No NSFW content
While lemmy.zip allows NSFW content this community is intended to be a place for all to feel welcome. Any NSFW content will be removed and the user banned.
If you have any comments or suggestions please message one of the moderators.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Weird because Gemini scores the worst on my personal accuracy testing.
Same. Right now I rank it Claude, everything else except NaziAI, ChatGPT & Gemini, NaziAI.
I've found that IBM's Granite4 3b works the best for home assistant. Claude is my #1 for code generation.
Ooo, I haven't tried Granite4, I'll check it out.
Same as Siri then
Do you suspect your personal accuracy testing is a lot better than the global lmsys arena leaderboard?
My tests are very basic, but covers a lot of things relevant to my personal life. Gemini failed to correctly respond to a single one of my tests.
Gemini struggled the most with false information. Both creating falsehoods and accepting them without question. The most difficult thing for most LLMs was responding "I don't know" or "that's not right". It is my firm belief that any lack of knowledge should be identified and handled by RAG.