this post was submitted on 03 Mar 2025
881 points (99.3% liked)

Technology

64653 readers
6217 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots

founded 2 years ago
MODERATORS
L3s@lemmy.world
enu@lemmy.world
technopagan@lemmy.world
L4s@lemmy.world
881
Judges Are Fed up With Lawyers Using AI That Hallucinate Court Cases (www.404media.co)
submitted 5 days ago by some_guy@lemmy.sdf.org to c/technology@lemmy.world
127 comments fedilink hide all child comments
 

But the explanation and Ramirez’s promise to educate himself on the use of AI wasn’t enough, and the judge chided him for not doing his research before filing. “It is abundantly clear that Mr. Ramirez did not make the requisite reasonable inquiry into the law. Had he expended even minimal effort to do so, he would have discovered that the AI-generated cases do not exist. That the AI-generated excerpts appeared valid to Mr. Ramirez does not relieve him of his duty to conduct a reasonable inquiry,” Judge Dinsmore continued, before recommending that Ramirez be sanctioned for $15,000.

Falling victim to this a year or more after the first guy made headlines for the same is just stupidity.

you are viewing a single comment's thread
view the rest of the comments
[–] Telorand@reddthat.com 157 points 5 days ago (72 children)

“Mr. Ramirez explained that he had used AI before to assist with legal matters, such as drafting agreements, and did not know that AI was capable of generating fictitious cases and citations,” Judge Dinsmore wrote in court documents filed last week.

Jesus Christ, y'all. It's like Boomers trying to figure out the internet all over again. Just because AI (probably) can't lie doesn't mean it can't be earnestly wrong. It's not some magical fact machine; it's fancy predictive text.

It will be a truly scary time if people like Ramirez become judges one day and have forgotten how or why it's important to check people's sources yourself, robot or not.

[–] catloaf@lemm.ee 58 points 5 days ago (10 children)

No probably about it, it definitely can't lie. Lying requires knowledge and intent, and GPTs are just text generators that have neither.

[–] DancingBear@midwest.social 3 points 4 days ago (5 children)

So it can not tell the truth either

[–] FiskFisk33@startrek.website 7 points 4 days ago* (last edited 4 days ago) (1 children)

not really no. They are statistical models that use heuristics to output what is most likely to follow the input you give it

They are in essence mimicking their training data

[–] DancingBear@midwest.social 0 points 4 days ago (1 children)

So I think this whole thing about whether it can lie or not is just semantics then no?

[–] FiskFisk33@startrek.website 9 points 4 days ago (1 children)

everything is semantics.

Lying is telling a falsehood intentionally

LLM's clearly lack the prerequisite intentionality

[–] DancingBear@midwest.social 2 points 4 days ago* (last edited 4 days ago) (1 children)

They can’t have intent, no?

The llm is incapable of having intent because it’s just programming

[–] FiskFisk33@startrek.website 6 points 4 days ago

precisely, which is why they cannot lie, just respond with no real grasp of wether what they output is truth or falsehoods.

load more comments (3 replies)
load more comments (7 replies)
load more comments (68 replies)