this post was submitted on 17 Feb 2026
82 points (98.8% liked)

Fuck AI

6157 readers
835 users here now

"We did it, Patrick! We made a technological breakthrough!"

A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.

AI, in this case, refers to LLMs, GPT technology, and anything listed as "AI" meant to increase market valuations.

founded 2 years ago
MODERATORS
 

Semantic ablation is the algorithmic erosion of high-entropy information. Technically, it is not a "bug" but a structural byproduct of greedy decoding and RLHF (reinforcement learning from human feedback).

During "refinement," the model gravitates toward the center of the Gaussian distribution, discarding "tail" data – the rare, precise, and complex tokens – to maximize statistical probability. Developers have exacerbated this through aggressive "safety" and "helpfulness" tuning, which deliberately penalizes unconventional linguistic friction. It is a silent, unauthorized amputation of intent, where the pursuit of low-perplexity output results in the total destruction of unique signal.

"No wonder politicians are so enamoured by AI.." -> Anonymous Coward in the comments of this article

you are viewing a single comment's thread
view the rest of the comments
[–] starik@lemmy.zip 2 points 2 weeks ago (5 children)

If they wanted, they could just turn a knob to have it spit out “tail data” more often.

[–] WolfLink@sh.itjust.works 7 points 2 weeks ago (3 children)
[–] Luccus@feddit.org 4 points 2 weeks ago* (last edited 2 weeks ago)

It's called XTC (exclude top choice) and is implented in a bunch of sorters. It's also used to jailbreak a bunch of models.

Edit: https://github.com/oobabooga/text-generation-webui/pull/6335

load more comments (2 replies)
load more comments (3 replies)