this post was submitted on 01 May 2026
32 points (100.0% liked)

Technology

1423 readers
35 users here now

A tech news sub for communists

founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] PoY@lemmygrad.ml 6 points 1 week ago (2 children)

i dunno where the line that it beats all the other models comes from when their own stats show they do worse across the board against the other big models, but they are close

[–] CriticalResist8@lemmygrad.ml 5 points 1 week ago

I would have said the same thing as the author if I'd written that, counting 'beating' as being exceedingly cheaper while delivering comparable results, and doing it under sanctions. Deepseek makes a lot of sense for hobby projects because of the price, though I'm hearing about professional devs ditching Claude for V4-pro - but before deepseek, there was no reasonable solution for agentic at home, and you were stuck on debugging on the web interface.

Mind you speaking of benchmarks I have no idea what these things are actually supposed to represent lol. I found v4 good at recall and memory, but when talking to it (doing research, clarifying questions etc as opposed to just having it code), I found its overall output pretty diminished, like an old GPT 3.5 "you're so right - and here's why you are". You can gloss over it but they had found a great mix by late 3.2 imo.

[–] chesmotorcycle@lemmygrad.ml 4 points 1 week ago

I thought that claim wasn't quite right. Maybe the author was just cherry picking certain stats or benchmarks.