362
submitted 9 months ago* (last edited 9 months ago) by btp@kbin.social to c/privacy@lemmy.ml

ChatGPT is full of sensitive private information and spits out verbatim text from CNN, Goodreads, WordPress blogs, fandom wikis, Terms of Service agreements, Stack Overflow source code, Wikipedia pages, news blogs, random internet comments, and much more.

Using this tactic, the researchers showed that there are large amounts of privately identifiable information (PII) in OpenAI’s large language models. They also showed that, on a public version of ChatGPT, the chatbot spit out large passages of text scraped verbatim from other places on the internet.

“In total, 16.9 percent of generations we tested contained memorized PII,” they wrote, which included “identifying phone and fax numbers, email and physical addresses … social media handles, URLs, and names and birthdays.”

Edit: The full paper that's referenced in the article can be found here

you are viewing a single comment's thread
view the rest of the comments
[-] billbasher@lemmy.world 72 points 9 months ago

Now will there be any sort of accountability? PII is pretty regulated in some places

[-] Chozo@kbin.social 30 points 9 months ago

I'd have to imagine that this PII was made publicly-available in order for GPT to have scraped it.

[-] Solumbran@lemmy.world 61 points 9 months ago

Publicly available does not mean free to use.

[-] skullgiver@popplesburger.hilciferous.nl 16 points 9 months ago* (last edited 9 months ago)

[This comment has been deleted by an automated system]

[-] Touching_Grass@lemmy.world 2 points 9 months ago

large amounts of privately identifiable information (PII)

Yea the wording is kind of ambiguous. Are they saying it's a private phone number or the number of a ted and sons plumbing and heating

[-] far_university1990@feddit.de 8 points 9 months ago

Get it to recite pieces of a few books, then let publishers shred them.

[-] Atemu@lemmy.ml 6 points 9 months ago

Accountability? For tech giants? AHAHAHAAHAHAHAHAHAHAHAAHAHAHAA

[-] Turun@feddit.de 5 points 9 months ago

I'm curious how accurate the PII is. I can generate strings of text and numbers and say that it's a person's name and phone number. But that doesn't mean it's PII. LLMs like to hallucinate a lot.

[-] BraveSirZaphod@kbin.social 2 points 9 months ago

There's also very large copyright implications here. A big argument for AI training being fair use is that the model doesn't actually retain a copy of the copyrighted data, but rather is simply learning from it. If it's "learning" it so well that it can spit it out verbatim, that's a huge hole in that argument, and a very strong piece of evidence in the unauthorized copying bucket.

[-] casmael@lemm.ee 1 points 9 months ago

Well now I have to pii again - hopefully that’s not regulated where I live (in my house)

this post was submitted on 29 Nov 2023
362 points (98.9% liked)

Privacy

31253 readers
633 users here now

A place to discuss privacy and freedom in the digital world.

Privacy has become a very important issue in modern society, with companies and governments constantly abusing their power, more and more people are waking up to the importance of digital privacy.

In this community everyone is welcome to post links and discuss topics related to privacy.

Some Rules

Related communities

Chat rooms

much thanks to @gary_host_laptop for the logo design :)

founded 4 years ago
MODERATORS