this post was submitted on 04 Feb 2026
169 points (100.0% liked)
Fuck AI
5558 readers
1286 users here now
"We did it, Patrick! We made a technological breakthrough!"
A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.
AI, in this case, refers to LLMs, GPT technology, and anything listed as "AI" meant to increase market valuations.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I don't think we've overcome the halfglass of wine issue, rather, we've papier-mâchéd over some fundamental flaws in precisely what it is happening when an LLM creates the appearance of reason. In doing saw we're baking a certain amount of sawdust into the cake, and the fact that no substantive advances has really been made since maybe the 4, 4.5 days, with most of the "improvements" being seen coming from basically better engineering, its clear we've hit an asymptote with what these models are capable/ will be capable, and it will never manifest into a full reasoning system that can self correct.
There is no amount of engineering sandblasting that can overcome issues which are fundamental to the models structure. If the rot is in the bones, its in the bones.
Nah there have been huge advancements in the past few months, you are definitely out of touch if you havent witnessed them
Recent models have gotten WAY better at "second guessing" themselves, and not acting nearly so confidently wrong.
That isnt an LLM issue at all, that has nothing to do with LLMs in fact. Thats a problem with Stable Diffusion which is an entirely different kind of AI, but yeah that issue is fundamental to what stable diffusion is.
I mean, thats not much different from any other tech, a LOT of advanced tech we have today is dozens and dozens of separate bits of engineering all working in tandem to create something more meaningful.
Your smartphone has countless different and distinct advancements on different types of technology that come together to make a useful device, and if you removed any one of those pieces from it, it would be substantially less useful as a tool.
So yeah, I personally will very much count the other pieces of the puzzle, advancing, as the system as a whole advancing.
LLMs today compared to ones a year ago are quite a bit better, by a large degree, and the tooling around them has also improved a lot. The proliferation of Model Context Protocol Tools is proving to be a massive part of the system as a whole becoming something actually very useful.
Perhaps you didn't notice the forum you're posting in. We're not here because we love hearing slopaganda.
Personally I believe MCP is the new AMP, and I look forward to dancing on its grave.
Care to elaborate? MCP is a fairly basic concept and just a specific type of a web server, so its not exactly going to go anywhere anytime soon, since you are literally posting on a forum right now that uses the same tech, lol
Sorry, are you talking about MCP, or AP? I don't know why any usage of PieFed (what I'm using) or Lemmy would require MCP.
MCP as a way to make agents appear smart is a smoke screen. We already have APIs to enable different online applications to talk to each other, it's called REST, or Hypermedia if you want to get real fancy. We don't need yet another layer on top that obscures web properties and places them behind chatbots benefiting Big Tech megacorps and nobody else.
I'm not out of touch whatsoever. I'm in the cut, and I've been here since long before LSTM's, and even perceptrons. I can almost promise you I'm deeper into this world than you'll ever be. I publish on this stuff.
No. They aren't. They've stalled and its very clear they've stalled. There have been improvements in some of the background engineering that create the illusion of model improvement, but this is fundamentally different than the improvements we saw from the earliest transformers to gpt's, from 2021-2023/4.
No, it is. And there is no clear way around it. It is an LLM issue because its a transformers issue, and it might even go deeper and be a back prop issue.
The "wine glass half full" thing, I assume, is you referring to the problem surrounding trying to image generate a specific glass of wine, or similar issues of "generate a room that definitely doesnt have an elephant in it, its devoid of any elephants, zero elephants in the room"
This is specifically a stable diffusion problem, and doesnt really apply to LLMs in the same manner.
Its not a problem specific to any model. Its present in all LLM's and possibly/ probably all transformers, and potentially even deeper. I get you don't get it, so just go take a break.
Not being able to generate something like a glass of wine is just a symptom of something far more significant.