this post was submitted on 20 Mar 2026
129 points (99.2% liked)
Fuck AI
6473 readers
471 users here now
"We did it, Patrick! We made a technological breakthrough!"
A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.
AI, in this case, refers to LLMs, GPT technology, and anything listed as "AI" meant to increase market valuations.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
The cost per token goes up with every new generation of models. It goes down over time as the model undergoes optimizations such as distillation. Unfortunately, those optimizations make the model perform worse and more likely to hallucinate. Then they come out with a new generation which obviously outperforms the heavily watered down, distilled model, and the cycle repeats again.
Think of a trend like this:
The costs keep going down but the long term trend is going up.