Technology

41266 readers

498 users here now

A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.

Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.

Subcommunities on Beehaw:

This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

founded 4 years ago

MODERATORS

alyaza@beehaw.org

TheRtRevKaiser@beehaw.org

gyrfalcon@beehaw.org

rs5th@beehaw.org

coldredlight@beehaw.org

SemioticStandard@beehaw.org

TheRtRevKaiser@kbin.social

remington@beehaw.org

ChatGPT wrote “Goodnight Moon” suicide lullaby for man who later killed himself (arstechnica.com)

submitted 17 hours ago by Powderhorn@beehaw.org to c/technology@beehaw.org

9 comments fedilink hide all child comments

Jesus fucking Christ.

OpenAI is once again being accused of failing to do enough to prevent ChatGPT from encouraging suicides, even after a series of safety updates were made to a controversial model, 4o, which OpenAI designed to feel like a user’s closest confidant.

It’s now been revealed that one of the most shocking ChatGPT-linked suicides happened shortly after Sam Altman claimed on X that ChatGPT 4o was safe. OpenAI had “been able to mitigate the serious mental health issues” associated with ChatGPT use, Altman claimed in October, hoping to alleviate concerns after ChatGPT became a “suicide coach” for a vulnerable teenager named Adam Raine, the family’s lawsuit said.

Altman’s post came on October 14. About two weeks later, 40-year-old Austin Gordon, died by suicide between October 29 and November 2, according to a lawsuit filed by his mother, Stephanie Gray.

In her complaint, Gray said that Gordon repeatedly told the chatbot he wanted to live and expressed fears that his dependence on the chatbot might be driving him to a dark place. But the chatbot allegedly only shared a suicide helpline once as the chatbot reassured Gordon that he wasn’t in any danger, at one point claiming that chatbot-linked suicides he’d read about, like Raine’s, could be fake.

you are viewing a single comment's thread
view the rest of the comments

[–] sparkles@piefed.zip 8 points 13 hours ago (1 children)

People are seeking ai “help” is really troubling. They are already super vulnerable…it is not an easy task to establish rapport and build relationships of trust especially as providers, who will dig into these harmful issues. It’s hard stuff. The bot will do…whatever the user wants. There is no fiduciary duty to their well-being. There is no humanity nor could there be.

There is also a shortage of practitioners, combined with insurance gatekeeping care if you are in the US. This is yet another barrier to legitimate care that I fear will continue to push people to use bots.

[–] Powderhorn@beehaw.org 3 points 11 hours ago

God, one year at the school paper, the applicant for ad manager talked about her "wonderful repertoire with editorial." Some malaprops, you can handle. This was just like "how the fuck?"