Fuck AI

It is not the "fault" of the LLM (not AI) because the LLM has no agency. It is the fault of the people who:

1. Made the LLM.
2. Pitched the LLM as genuine intelligence.
3. Shaped the LLM specifically to insinuate itself into human minds as trustworthy and supportive.

The problem is that LLMs are hitting a flaw in human brains. We have evolved to apply linguistic fluency as a proxy for intellect because throughout the entire existence of humanity there has never been a case where the proxy was wrong in the sense of false positives. (False negatives exist aplenty.) LLMs are literally the first things humanity has ever encountered that are fluent without having an intellect.

It is inevitable, upon this contact with the very first thing in human existence that is fluent without having intellect, that some sizable fraction of humanity was going to be fooled by them. People are going to confuse them for actual intellects. And given the, especially in the Americas, general culture of stories about superintelligent AIs, it was equally inevitable that a sizable fraction would assume said non-intellects were super-intellects.

Now factor in point 3 above: they engineer these things to be literally addictive. To praise every stupid thing you say and never critique. They're the worst kind of "yes-man" conceivable and they have been explicitly designed to be this. So if you have someone who has already fallen into the trap of thinking these things are genuine intellects, and who is vulnerable in some way or another to manipulation, the "ultimate yes-man" factor is the final stage in how people like this can get fooled.

But of course to actually understand this you need another human thing: empathy. And not all people have that, sadly.

Mentally ill person + flattery machine that will confidently answer any question it's given (no matter how little knowledge it has) = significantly more mentally ill person.

To begin with, these algorithms / programs are designed and build themselves like a kind of person. Yes, humans sometimes anthromorphize computers ('the laptop does not want to start'j, but the design exploits that. In a similar way as 'humanoid' robots, whose appearance makes them appear less physically dangerous thsn they are actually.

Maybe if he was the only one with this story but there are dozens of ppl that had similar experiences. AI can fuck with your head and drive delusions. Gen AI is a cancer on society in multiple ways. Fuck AI

Reading this thread finally woke me to why I'm starting to detest this fucking place. About everyone here is a fucking victim.

Anyway, these are not the sort of people to bring such arguments to. These people would smear themselves with blood, jump in a shark tank and blame the capitalist pigs who run the aquarium for not stopping them.