this post was submitted on 15 Jun 2026
20 points (85.7% liked)

Technology

85461 readers
3711 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] MagicShel@lemmy.zip 1 points 14 hours ago (1 children)

I didn't downvote, as I don't do that to comments that show thoughtful effort, whether I disagree or not. And I'm certainly not in lockstep with Lemmy on AI, so I can't speak for anyone but me.

There are some places I agree, and some I don't. First, I agree that the three laws are a good idea. However, they are compressed in human language and it is unsurprisingly ambiguous as to the meaning of harm. While harm is often unambiguous, I have a feeling if you could somehow survey the world on all possible actions, no two people would completely agree on what is harmful. If we can't clearly define it for ourselves, we certainly can't choose to it or create an AI that agrees. So as nice as the idea of the three laws is, they are not feasible.

I think you are spot on about trust and AI. My computer has prompted me a thousand times for approval of some innocuous text expansion in a cli command. It has never attempted something I didn't want. I do often have to go back and change how it has done something. And I run frequent scans for alignment of documentation so that I can be sure someone looking at the acceptance criteria doesn't come away with a different idea than someone who looks at the diagrams.

But we diverge on matters of responsibility. I think it must be incumbent upon the person using the AI to understand the fundamental flaws of such systems. And I think a company that provides unreviewed AI output must ensure users are aware that output can be harmful or incorrect. Ultimately the nature of these systems can only approximately comply with lack of harm.

I think responsibility comes once you present AI output to something who doesn't consent or understand AI. (Side note: making it a requirement that a user must be 18 to be provided AI output might fix a lot of issues because for example customer service bots can't guarantee a caller is over 18.)

The ways to use AI are myriad and it's impossible to know how "come home to me" (the text which encouraged one of the suicides) is going to be taken by the user. In fact, I'd interpret that phrase as imploring the user to stay alive.

Ultimately, "no harm" can never be guaranteed because life is subjective. And no AI can be rendered harmless yet still do anything useful. That's why human judgment and skepticism is needed on the output. I am hopeful AI can be fully democratized, but critical thinking is always required, just like the time I had a high school teacher tell me blind people can see through a sort of third eye.

That doesn't obviate the AI company of any responsibility whatsoever, but I think it's fine to hold them to standards of reasonable effort to mitigate foreseeable harms.

[–] Buffalox@lemmy.world 2 points 14 hours ago* (last edited 14 hours ago) (1 children)

Thanks for the good constructive response. πŸ‘

a company that provides unreviewed AI output must ensure users are aware that output can be harmful or incorrect.

I agree, and then we should require such warnings for every AI response, kind of like we have on cigarettes.
Meaning the responsibility to warn about harmful effects is up to the company offering the service, not for the user to assume.

I think responsibility comes once you present AI output to something who doesn’t consent or understand AI.

Which means 99.9% of the users currently using AI, or unknowingly exposed to it through services that use AI without it being clear.

[–] MagicShel@lemmy.zip 1 points 13 hours ago (1 children)

Which means 99.9% of the users currently using AI, or unknowingly exposed to it through services that use AI without it being clear.

It's tricky, you know? IMO, you can't democratize AI (which IMO we must do) if you need some sort of IQ test to be allowed to use it. A checkbox acknowledging risk acceptance is insufficient. But also, yes, you have to have some awareness of what AI even is or you are at risk of being harmed.

[–] Buffalox@lemmy.world 1 points 8 hours ago* (last edited 8 hours ago) (1 children)

you have to have some awareness of what AI even is or you are at risk of being harmed.

Yes that's how it is, but that should not be the case, AI should legally be considered like asking expert advice, like asking a lawyer or a doctor, those are not considered risks, because they have legal responsibility for their advice. The same must be the case for AI, AI must have similar legal responsibility covered by the company offering the AI service.

If AI responses can't be trusted and are false information, it's not a service but a disservice. It can never be the case that normal users should have particular skills to use an AI service. That's legally a slippery slope we should absolutely refuse to allow.

[–] MagicShel@lemmy.zip 1 points 6 hours ago

AI should legally be considered like asking expert advice, like asking a lawyer or a doctor

That is impossible. AI has no consciousness or ability to reason about the answers it is giving. Without a thinking domain expert between the user and the AI, this simply cannot be done.

If AI responses can't be trusted and are false information

AI response can't be trusted. Everyone should know that. There is no possible way to design a system where AI can be trusted. Hell, you can't even design a system where a human can be trusted to be infallible.

You don't need a particular skill to use AI as a service β€” which isn't to say the results are going to be worth a crap if you aren't a domain expert. Anyone can ask AI to build a web service and get it approximately correct, but you need someone who knows how to build a web service to tell the AI what it needs to build it correctly.

But one does need to understand that the output from AI should only be used when the marginal cost of failure is near-zero.