97
Google explains Gemini’s “embarrassing” AI pictures of diverse Nazis
(www.theverge.com)
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 23 Feb 2024
97 points (91.5% liked)
Technology
60012 readers
2605 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 2 years ago
MODERATORS
The best part is that this was added in response to people complaining about it not generating diverse enough people, so they made it randomly add different races to person requests that don't specify race.
Why would anyone do that? Like just tell the AI you want diverse people yourself, making it the default just adds more moving parts that could fail(and you end up with diverse nazis or ryan gosling as black panther)
It's done because the underlying training data is heavily biased to begin with. It's been a known issue for along time with AI/ML, for example racist cameras have been an issue for decades https://petapixel.com/2010/01/22/racist-camera-phenomenon-explained-almost/.
So they do this to try to correct for biases in their training data. It's a terrible idea, and shows the rocky path forward for GenAI, but it's easier than actually fixing the problem ¯\_(ツ)_/¯