AI Generated

53 readers

2 users here now

This is a community for any content generated using AI (images, music, code, etc.). Must follow all server rules.

founded 1 month ago

MODERATORS

jaykrown@lemmy.world

-3

I am working on an "AI Efficiency Index" (lemmy.world)

submitted 1 month ago by jaykrown@lemmy.world to c/AIGenerated@lemmy.world

3 comments fedilink hide all child comments

DeepSeek V3.2-Exp (September 2025) — 80.00
Kimi K2 Thinking (November 2025) — 72.59
Gemini 2.5 Flash (May 2025) — 68.79
GPT-5 (August 2025) — 23.44
o3 (April 2025) — 22.57
Gemini 2.5 Pro (March 2025) — 21.37
Gemini 3 Pro (November 2025) — 16.93
Claude 3.5 Sonnet (August 2025) — 11.67
GPT-5 Pro (August 2025) — 1.96

The goal is to find out which models are the best practical performance per dollar spent on real world available API pricing. Right now it seems like DeepSeek and Kimi are winning, and Google has lost its way since Gemini 2.5 Flash.

This interests me because LLMs are global, especially if they're open sourced like Kimi K2 Thinking. Anyone can use the cheaper one just as easily, and no tariffs or policy can stop it.

you are viewing a single comment's thread
view the rest of the comments

[–] jaykrown@lemmy.world 1 points 1 month ago

Thank you, I'll factor that into the index. If you have any other recommendations for how to make the index more robust let me know. The goal is to make this dependent on real world API costs. I don't care if the newest smartest model is released if it costs $100 every time to use.