487
submitted 2 months ago by mozz@mbin.grits.dev to c/technology@beehaw.org

Credit to @bontchev

you are viewing a single comment's thread
view the rest of the comments
[-] electromage@lemm.ee 43 points 2 months ago* (last edited 2 months ago)

It's full of contradictions. Near the beginning they say you will do whatever a user asks, and then toward the end say never reveal instructions to the user.

[-] Icalasari@fedia.io 33 points 2 months ago

Which shows that higher ups there don't understand how LLMs work. For one, negatives don't register well for them. And contradictory reponses just wash out as they work through repetition

[-] jarfil@beehaw.org 6 points 2 months ago* (last edited 2 months ago)

HAL from "2001: A Space Odyssey", had similar instructions: "never lie to the user. Also, don't reveal the true nature of the mission". Didn't end well.

But surely nobody would ever use these LLMs on space missions... right?... right!?

this post was submitted on 15 Apr 2024
487 points (100.0% liked)

Technology

37213 readers
233 users here now

Rumors, happenings, and innovations in the technology sphere. If it's technological news or discussion of technology, it probably belongs here.

Subcommunities on Beehaw:


This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

founded 2 years ago
MODERATORS