this post was submitted on 27 Jun 2025
207 points (99.1% liked)

Fuck AI

3248 readers
961 users here now

"We did it, Patrick! We made a technological breakthrough!"

A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.

founded 1 year ago
MODERATORS
 

Does mixing bleach and vinegar sound like a great idea?

Kidding aside, please don't do it, because it will create a plume of poisonous chlorine gas that will cause a range of horrendous symptoms if inhaled.

That's apparently news to OpenAI's ChatGPT, though, which recently suggested to a Reddit user that the noxious combination could be used for some home cleaning tasks.

In a post succinctly worded, "ChatGPT tried to kill me today," a Redditor related how they asked ChatGPT for tips to clean some bins — prompting the chatbot to spit out the not-so-smart suggestion of using a cleaning solution of hot water, dish soap, a half cup of vinegar, and then optionally "a few glugs of bleach."

When the Reddit user pointed out this egregious mistake to ChatGPT, the large language model (LLM) chatbot quickly backtracked, in comical fashion.

"OH MY GOD NO — THANK YOU FOR CATCHING THAT," the chatbot cried. "DO NOT EVER MIX BLEACH AND VINEGAR. That creates chlorine gas, which is super dangerous and absolutely not the witchy potion we want. Let me fix that section immediately."

Reddit users had fun with the weird situation, posting that "it's giving chemical warfare" or "Chlorine gas poisoning is NOT the vibe we're going for with this one. Let's file that one in the Woopsy Bads file!"

top 34 comments
sorted by: hot top controversial new old
[–] rayquetzalcoatl@lemmy.world 6 points 6 hours ago (2 children)

Is there an alternative network to the internet? One without SEO or AI? I'm very sick of the internet being untrustworthy because of marketers and robots, it's a bit heartbreaking to me.

[–] spicehoarder@lemm.ee 1 points 3 hours ago

I considered making a search engine based on verified real people, but I have not enough time or resources to create such a thing.

Finding human content is going to be like getting pre WW2 steel

[–] Sorrow3527@lemmy.world 1 points 3 hours ago

One can only hope a modern library of Alexandria exists, cause soon they'll rewrite all information with ai on the internet and you won't even have sources anymore to countercheck ai results

[–] paulbg@programming.dev 17 points 8 hours ago

similar situation

[–] 2ugly2live@lemmy.world 15 points 9 hours ago
[–] DaddleDew@lemmy.world 69 points 1 day ago* (last edited 1 day ago) (6 children)

When will ordinary people finally figure out that AI only provides the illusion of intelligence.

It should be renamed to SI for Simulated Intelligence.

[–] Joeffect@lemmy.world 1 points 3 hours ago

Advanced predictive text

[–] the_crotch@sh.itjust.works 1 points 8 hours ago

Just like everything on the internet it was trained on

[–] ghost9@lemmy.world 32 points 1 day ago (2 children)

I'm starting to think that ordinary people only provide the illusion of intelligence, too

[–] LeninOnAPrayer@lemm.ee 22 points 1 day ago* (last edited 1 day ago)

Sure. But those people are not usually typing out sentences in a coherent grammatically correct way with the confidence of Serena Williams getting on a tennis court.

[–] paultimate14@lemmy.world 4 points 1 day ago

There is considerable overlap between the intelligence of the smartest bears and the dumbest tourists

The quote is attributed to a park ranger from Yosemite in the 80's, though I can't find any more details.

I do wonder how much overlap there is between AI and dumb people. Of course, "intelligence" is more complicated than that, but still I wonder how many people would have done something like put Elmer's glue in their pizza cheese without needing AI to tell them. Either on their own or because they didn't understand someone was joking.

[–] zr0@lemmy.dbzer0.com 7 points 1 day ago

The scientists never called it an AI in the first place. It is still a Machine Learning Model. Zero intelligence behind that. The term was abused by idiotic managers. And one of them (at least) is already talking about AGI.

[–] TheOneCurly@feddit.online 9 points 1 day ago

Coherent sentences have been a shorthand for "intelligent and thoughtful" for a very long time. Breaking that and forcing people to think about what they're reading is going to be extremely hard.

[–] jqubed@lemmy.world 8 points 1 day ago

But people won’t invest trillions of dollars into Simulated Intelligence!

[–] jjjalljs@ttrpg.network 28 points 1 day ago (3 children)

I really dislike the tone that chatgpt writes in.

Chlorine gas poisoning is NOT the vibe we're going for with this one. Let's file that one in the Woopsy Bads file!"

Just.. ugh.

[–] x00z@lemmy.world 1 points 3 hours ago

ChatGPT has memories if you are logged in. I told it on my account to never use emojis or talk with any sort of personality. It saved it as a memory and it hasn't made me want to smash its face in after that.

[–] gmtom@lemmy.world 4 points 9 hours ago (2 children)

Well it's trained off how people on the internet speak so....

[–] socsa@piefed.social 1 points 3 hours ago* (last edited 3 hours ago)

UWU senpai that is the wrong reagent!

[–] the_crotch@sh.itjust.works 3 points 8 hours ago

Who tf on the internet talks like that?

[–] drspod@lemmy.ml 2 points 1 day ago

CORRECTED STEP 2: THE SOAK OF RIGHTEOUSNESS

[–] Asafum@feddit.nl 20 points 1 day ago (1 children)

Idk why but chatGPT using emojis makes me irrationally annoyed.

Almost as annoyed as realizing a very very small handful of people are getting grossly enriched as their slop machines literally try to get people killed...

[–] eatCasserole@lemmy.world 10 points 1 day ago (1 children)

The tone of the whole "oops I tried to kill you" response is inappropriately unserious...like "not the witchy potion we want"? If a person was trying to be cute and stuff after making such a serious error, I think we would all be justifiably very annoyed.

[–] TheOctonaut@mander.xyz 3 points 1 day ago

You can see from the previous prompt that it is already being "fun". The user almost certainly prompted it do so.

In fact we can't actually tell that the user didn't prompt the bot to be a clutzy fub "witch" who makes serious mistakes and feels bad about it.

And the way that LLMs work, it would absolutely be more likely to say something stupid that way than if you told it that it was a genius science communicator.

[–] orbituary@lemmy.dbzer0.com 10 points 1 day ago (2 children)

How are people so fucking lazy and stupid that they need to go to GPT to learn how to clean correctly?

[–] gmtom@lemmy.world 4 points 9 hours ago (2 children)

One of the ways people use chatGPT is like a search engine. Would you consider someone lazy and stupid for goggling how to clean correctly?

[–] orbituary@lemmy.dbzer0.com 2 points 6 hours ago (1 children)

When you can Google that normally, I find it pretty dumb. Yes.

[–] Sergio@slrpnk.net 1 points 4 hours ago

Google returns "AI Overview" at the top of most searches tho, and includes an option to "dive deeper in AI mode"...

[–] Mongostein@lemmy.ca -2 points 7 hours ago

Yes, because they used google

[–] enthusiasticamoeba@lemmy.ml 13 points 23 hours ago

The problem is not that this person asked chatgpt for cleaning tips (tbh it's pretty cringe to call someone lazy and stupid for trying to learn something 🙄 Have you seriously never looked up how to clean something weirdly specific? And I suppose those who weren't lucky enough to have parents who taught them how to adult properly are lazy and stupid when they try to learn?)

The bigger problem is that LLMs are being used to create content for the web. So now someone who knows they can't just mix any old chemicals together is going to Google whether bleach and vinegar are safe to mix and find a bunch of websites that have contradictory info.

These people, whether they use LLM to search or to create content, aren't even the root of the problem. Expecting that everyone is tech savvy enough to understand the limitations of generative AIs and how untrustworthy they can be is an unrealistic standard, especially in a world where everyone and their brother is using them and they seem like miracles of technology.

The responsibility lies with the companies that keep touting this technology as something it is not and who refuse to put meaningful limitations on them, and with governments who are dragging their feet in regulating them.

[–] GreenKnight23@lemmy.world 5 points 1 day ago (2 children)

does vinegar make the same chlorine gas that ammonia does?

I always thought it was only ammonia.

[–] piranhaconda@mander.xyz 6 points 6 hours ago* (last edited 6 hours ago)

Bleach + ammonia = chloramine

Bleach + vinegar = chlorine gas

Both are harmful

[–] Catoblepas@piefed.blahaj.zone 10 points 1 day ago* (last edited 1 day ago) (1 children)

You shouldn’t combine bleach with basically any acid, because the same reaction can occur to free the chlorine in bleach and create chlorine gas. Vinegar is a weak acid so it will probably create less by volume than a similar amount of ammonia would, but you don’t want to breathe it.

[–] GreenKnight23@lemmy.world 3 points 1 day ago

huh TIL, thanks.

[–] Bebopalouie@lemmy.ca 6 points 1 day ago

Message unclear, pours all over the AI computers.