submitted 1 year ago* (last edited 1 year ago) by ArmoredCavalry@lemmy.world to c/technology@lemmy.world

12 comments fedilink hide all child comments

When the idea of self-driving cars first started becoming mainstream, I remember a lot of debate about liability. If an accident occurs, who would be at fault? I think a lot of those questions are still unanswered.

Fast forward and now we have software like ChatGPT. I assume they'll only become more capable (and connected) over time.

Which makes it strange I haven't really heard any similar discussion around liability. What happens when it makes mistakes or causes damage?

Maybe in people's minds it doesn't matter, because AI is either something that helps with homework questions, or something that's taking over humanity. Reality is probably in between those two, with much more mundane mistakes or damages done.

What happens when the first ransomware is deployed by AI, on behalf of a user who just wanted tips on how to make more side income?

top 12 comments

sorted by: hot top controversial new old

[-] Brokkr@lemmy.world 17 points 1 year ago

As of yet, AIs are not taking independent actions (arguably unlike the cars). So for now, I think the person using the information would be liable, just like if they copied and pasted information from a site. The individual is responsible for the actions they take, although they may not have the necessary intent to commit certain crimes.

Regarding the cars, it could be argued that the drivers are responsible regardless of the features of the car. But it could also be argued that the features malfunctioned, preventing the driver from safely operating the vehicle. The manufacturer will likely argue thst the driver was operating the car incorrectly, and they will spend millions manufacturing this evidence.

[-] variants@possumpat.io 6 points 1 year ago

Wonder who is responsible if you hire one of those driverless cars and the car hits someone, since no one is in the driver's seat I imagine it would be the companies responsibility, it felt kind of creepy watching them drive around the last time I visited San Francisco but people seemed to be using them like if it was nothing haha

[-] catreadingabook@kbin.social 4 points 1 year ago

No way they don't force you to agree to some "terms and conditions" along the lines of, "You accept full responsibility of all risk and if we get sued, you agree to pay on our behalf. And because we know you won't read this, here's all the risks so we can say you gave informed consent: ..."

[-] catreadingabook@kbin.social 11 points 1 year ago* (last edited 1 year ago)

Completely speculating, because I don't know many courts that have been willing to decide either way, but maybe:

If it causes harm in a way that was reasonably foreseeable, the person who turned it on and/or the person "operating" it might be generally liable on a theory of negligence (but not always).

If the harm was unpredictable, it might be on the manufacturer and the retailer under a theory of products liability (but not always).

Or it could be treated as "ferae naturae," where owners are liable for their 'dangerous animal' pets because they knew the pets were dangerous and still decided to keep them (but not always).

If it's an AI not associated with a physical device, maybe the programmer who "authored" the lines of code could be criminally liable for criminal "speech" (writing an AI) that incites and enables crime, even as a conspirator -- that's reeeaaally doubtful on Due Process grounds, but it would definitely light a fire under every developer's chair to make sure their algorithms are explicitly trained against criminal behavior. (but still not always.)

[-] eager_eagle@lemmy.world 7 points 1 year ago

I mostly agree, with the exception of the last paragraph. The software world today is built on open source software that is distributed without guarantees and this is an amazing thing. If a liability like that is applied to AI, it would be easily generalized to any piece of software that might be used in malicious ways the author did not intend or predict. It would be akin to punishing a knife manufacturer for a stabbing.

It is ridiculously easy to write a genuinely well intentioned script that encrypts your files and a minor modification can turn that into a ransomware.

[-] catreadingabook@kbin.social 1 points 1 year ago* (last edited 1 year ago)

That's true, but thinking about AI that is made to generate speech, processing power is still expensive enough that developers are careful with it. But what happens as memory gets cheaper and calculations get faster, and ordinary developers are able to train their own generative AI?

For example, what happens when a developer decides to train a LLM extensively on scam emails, and spammers love to buy copies of it - but the developer markets it as just "a helpful generative AI"? Or, what if a person trains their LLM on an extremist forum full of hate speech and disinformation, then offers it to a suicide prevention center as a 24/7 alternative to human labor? (Treating these as hypotheticals, where we assume the difference isn't immediately obvious. Perhaps they also used some legitimate training data, so that most outputs seem innocent enough.)

To me it sounds more involved than selling just a word processor with autocorrect, but less involved than selling an instruction manual for committing crimes.

[-] eager_eagle@lemmy.world 1 points 1 year ago

But what happens as memory gets cheaper and calculations get faster, and ordinary developers are able to train their own generative AI?

That happens all the time since GANs entered the scene, and before that since alexnet broke image classification records in 2012 using consumer hardware. Anyone can train neural nets.

[-] catreadingabook@kbin.social 1 points 1 year ago* (last edited 1 year ago)

Ok, let me be more specific so that it's not open to uncharitable interpretation.

What happens when it becomes easy to make something as reliable and complete as, e.g., ChatGPT-4 without the hardware costs and other costs currently associated with it?

[-] 14th_cylon@lemm.ee 4 points 1 year ago

What happens when the first ransomware is deployed by AI, on behalf of a user who just wanted tips on how to make more side income?

that's not how it works... at all.

[-] ArmoredCavalry@lemmy.world 4 points 1 year ago

It isn't how it works today. I'm talking about sometime in the distant (or near) future. Surely at some point AI will have the capabilities on par with at least a low level hacker.

Or, if you still think that's a stretch, just imagine all the ways perfectly legitimate software can cost companies money. Not through malicious design, but just by mistakes.

[-] 14th_cylon@lemm.ee 1 points 1 year ago

It isn’t how it works today. I’m talking about sometime in the distant (or near) future.

that would be very distant future. what we have today is machine learning. it is a powerful tool, but it is not in any way intelligent. it is not going to realize itself and start war with humanity. we wouldn't know how to create something like that if we wanted.

if person uses that tool to generate some code that will cause damage, the consequences will be same as if that person writes that code entirely by hand. but it is not going to miraculously "go wild" and create some ethical dilemma where we wouldn't know who is responsible.

[-] Echo71Niner@lemm.ee 2 points 1 year ago

I would be a lot more worried about an AI that does that on purpose.

What happens when the first ransomware is deployed by AI, on behalf of a user who just wanted tips on how to make more side income?

this post was submitted on 29 Aug 2023

61 points (96.9% liked)

Technology

59438 readers

4317 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related content.
Be excellent to each another!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, to ask if your bot can be added please contact us.
Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago

MODERATORS