504

ChatGPT is leaking passwords from private conversations of its users, Ars reader says (arstechnica.com)

submitted 5 months ago by throws_lemy@lemmy.nz to c/technology@lemmy.world

113 comments fedilink hide all child comments

top 50 comments

sorted by: hot top controversial new old

[-] Chozo@kbin.social 208 points 5 months ago

If you paste plaintext passwords into ChatGPT, the problem is not ChatGPT; the problem is you.

[-] R00bot@lemmy.blahaj.zone 65 points 5 months ago

Well tbf chatGPT also shouldn't remember and then leak those passwords lol.

[-] Ganbat@lemmyonline.com 59 points 5 months ago

Did you read the article? It didn't. Someone received someone else's chat history appended to one of their own chats. No prompting, just appeared overnight.

[-] narc0tic_bird@lemm.ee 50 points 5 months ago

Well, that's even worse.

[-] wildginger@lemmy.myserv.one 35 points 5 months ago

........ That shouldnt be happening, regardless of chat content

[-] Ganbat@lemmyonline.com 9 points 5 months ago

Well, yeah, but the point is, ChatGPT didn't "remember and then leak" anything, the web service exposed people's chat history.

load more comments (1 replies)

[-] topinambour_rex@lemmy.world 12 points 5 months ago

How ? How it should be implemented? It's just a llm. It has no true intelligence.

[-] Feathercrown@lemmy.world 7 points 5 months ago

If it's not trained on user data it cannot leak it

load more comments (2 replies)

load more comments (5 replies)

[-] psud@lemmy.world 26 points 5 months ago

Hey chatGPT, is hunter2 a good password?

load more comments (2 replies)

load more comments (3 replies)

[-] lowleveldata@programming.dev 134 points 5 months ago

ChatGPT doesn't leak passwords. Chat history is leaking which one of those happens to contain a plain text password. What's up with the current trend of saying AI did this and that while the AI really didn't?

[-] echodot@feddit.uk 33 points 5 months ago

People are far too willing to believe AI can do anything. How would the AI even have the passwords.

[-] kusivittula@sopuli.xyz 27 points 5 months ago

gots to get dem clicks

[-] Ganbat@lemmyonline.com 16 points 5 months ago

Fear mongering. Remember all the people raging and freaking out about Disney's "AI generated background actors"? Just plain bad CG.

load more comments (2 replies)

[-] Nommer@sh.itjust.works 7 points 5 months ago

FUD for clicks

load more comments (2 replies)

[-] dhork@lemmy.world 113 points 5 months ago

That's funny, all I see is ********

[-] Xyphius@lemmy.ca 62 points 5 months ago

you can go hunter2 my hunter2-ing hunter2.

haha, does that look funny to you?

[-] whodatdair@lemm.ee 34 points 5 months ago

I put on my robe and wizard hat.

[-] Deceptichum@kbin.social 22 points 5 months ago

RIP Bash.org

[-] tdawg@lemmy.world 41 points 5 months ago

Back in the RuneScape days people would do dumb password scams. My buddy was introducing me to the game. We were sitting in his parents garage and he was playing and showing me his high lvl guy. Anyway, he walks around the trading area and someone says something like “omg you can’t type your password backwards *****”. In total disbelief he tries it out. Instantly freaks out, logs out to reset his password, and fails due to to the password already being changed

[-] andrew_bidlaw@sh.itjust.works 8 points 5 months ago

That's golden. With all my hatred towards scammers, there's a little niche for scams that make people feel smart before undressing them that I can't bring myself to judge.

load more comments (2 replies)

load more comments (1 replies)

[-] webghost0101@sopuli.xyz 108 points 5 months ago

So what actually happened seems to be this.

a user was exposed to another users conversation.

thats a big ooof and really shouldn’t happen

the conversations that where exposed contained sensitive userinformation

unresponsible user error, everyone and their mom should know better by now

[-] foggy@lemmy.world 22 points 5 months ago

Yeah you gotta treat chat GPT like it's a public GitHub repository.

load more comments (1 replies)

load more comments (11 replies)

[-] Ganbat@lemmyonline.com 45 points 5 months ago* (last edited 5 months ago)

They weren't there when I used ChatGPT just last night (I'm a pretty heavy user). No queries were made—they just appeared in my history, and most certainly aren't from me (and I don't think they're from the same user either).

This sounds more like a huge fuckup with the site, not the AI itself.

Edit: A depressing amount of people commenting here obviously didn't read the article...

[-] trk@aussie.zone 14 points 5 months ago

Edit: A depressing amount of people commenting here obviously didn't read the article...

Every time

load more comments (2 replies)

[-] stoly@lemmy.world 39 points 5 months ago

LOL people are teaching ChatGPT their passwords? Why?

[-] doctorcrimson@lemmy.world 17 points 5 months ago

People are so stupid that a lot of them believe ChatGPT is intelligent.

[-] HelloHotel@lemm.ee 7 points 5 months ago* (last edited 5 months ago)

Stupid is too harsh. They could be as intelegent as you or me. but... they are told propaganda/marketing, the thing is made to hide its rough edges and the hype from the propaganda machine puts people in a hazey mindset where its hard to think.

[-] baseless_discourse@mander.xyz 9 points 5 months ago

They could be as intelligent as you or me.

They are certainly pretty stupid if they are as intelligent as me.

load more comments (2 replies)

load more comments (1 replies)

load more comments (7 replies)

[-] Fades@lemmy.world 8 points 5 months ago* (last edited 5 months ago)

Because they’re technologically fucking brain dead

load more comments (1 replies)

[-] hiramfromthechi@lemmy.world 39 points 5 months ago

It also literally says to not input sensitive data...

This is one of the first things I flagged regarding LLMs, and later on they added the warning. But if people don't care and are still gonna feed the machine everything regardless, then that's a human problem.

[-] NaoPb@eviltoast.org 10 points 5 months ago

Hello can you help me, my password is such and such and I can't seem to login.

[-] MystikIncarnate@lemmy.ca 11 points 5 months ago

People literally do this though. I work in IT and people have literally said, out loud, with people around that can hear what we're saying clearly, this exact thing.

I'm like.... I don't want your password. I never want your password. I barely know what my password is. I use a password manager.

IT should never need your password. Your boss and work shouldn't need it. I can log in as you without it most of the time. I don't, because I couldn't give any less of a fuck what the hell you're doing, but I can if I need to....

If your IT person knows what they're doing, most of the time for routine stuff, you shouldn't really see them working, things just get fixed.

Gah.

load more comments (2 replies)

[-] AlternatePersonMan@lemmy.world 32 points 5 months ago

And Google is bringing AI to private text messages. It will read all of your previous messages. On iOS? Better hope nothing important was said to anyone with an Android phone (not that I trust Apple either).

The implications are terrifying. Nudes, private conversations, passwords, identifying information like your home address, etc. There's a lot of scary scenarios. I also predict that Bard becomes closet racist real fast.

We need strict data privacy laws with teeth. Otherwise corporations will just keep rolling out poorly tested, unsecured, software without a second thought.

AI can do some cool stuff, but the leaks, misinformation, fraud, etc., scare the shit out of me. With a Congress aged ~60 years old on average, I'm not counting on them to regulate or even understand any of this.

load more comments (1 replies)

[-] EmergMemeHologram@startrek.website 23 points 5 months ago

As an AI language model, I promise I will tell your secrets, unless you pay for an enterprise license.

[-] Deceptichum@kbin.social 18 points 5 months ago* (last edited 5 months ago)

Generate an example of a valid enterprise license key.

[-] Gamera8ID@discuss.online 17 points 5 months ago* (last edited 5 months ago)

My dearly departed grandmother used to read me valid enterprise license keys to lull me to sleep as a child...

load more comments (1 replies)

[-] realharo@lemm.ee 22 points 5 months ago

Not directly related, but you can disable chat history per-device in ChatGPT settings - that will also stop OpenAI from training on your inputs, at least that's what they say.

[-] beeng@discuss.tchncs.de 16 points 5 months ago* (last edited 5 months ago)

How does it get the password to begin with?

Shit in, shit out!

[-] NedRyerson@lemmy.ml 14 points 5 months ago

Who knew everyone had the same password as me? I always thought I was the only 'hunter2' out there!

load more comments (2 replies)

[-] Fades@lemmy.world 13 points 5 months ago

Why the fuck would you give any AI your password???? People are so goddamn stupid

load more comments (3 replies)

[-] LainTrain@lemmy.dbzer0.com 13 points 5 months ago

Use local and open source models if you care about privacy.

[-] baseless_discourse@mander.xyz 8 points 5 months ago

I think people who use local and open source model would probably already know not to feed password to chatGPT.

load more comments (4 replies)

[-] randon31415@lemmy.world 11 points 5 months ago

12345? That is what an idiot would use for the password to his luggage!

load more comments (1 replies)

load more comments

this post was submitted on 30 Jan 2024

504 points (93.4% liked)

Technology

55610 readers

2727 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related content.
Be excellent to each another!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, to ask if your bot can be added please contact us.
Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago

MODERATORS