this post was submitted on 16 Sep 2024
25 points (77.8% liked)

Firefox

17303 readers
22 users here now

A place to discuss the news and latest developments on the open-source browser Firefox

founded 4 years ago
MODERATORS
k_o_t@lemmy.ml
25
Throwback: 2019 Mozilla-affiliated group asks how to build a queerer CreepAI: a "non-committal sexting bot" emerges. (discourse.mozilla.org)
submitted 2 months ago by LWD@lemm.ee to c/firefox@lemmy.ml
8 comments fedilink hide all child comments
 

On Valentine's Day 2024, Mozilla came out with a piece critical of AI chatbots titled "Creepy.exe: Mozilla Urges Public to Swipe Left on Romantic AI Chatbots Due to Major Privacy Red Flags."

But before they found red flags, back in 2019, Mozilla promoted a workshop on a creepy, rainbow-washed, chatbot ecosystem where people identified as "queer" were required to bare their most intimate sexual thoughts.

From the post:

your... interactions will be recorded... you will occasionally be prompted with random survey questions

What kinds of questions did they randomly ask the people who would "queer the AI"? Creepy stuff like

Have you ever sexted with a stranger?
Have you ever sexted with a machine?
Do you remember the first time you were aroused by language?
Do you think an artificial intelligence could help fulfill some of these... needs?

The workshop providers guided people into establishing an intimate, sexual connection with the chatbot they could create.

How might we build trust with an AI?
How might we give it its own sense of desire?

Even the consenting participants in the workshop complained about the AI's creep factor:

it feels like the A.I. is gas-lighting you. Seems like a noncommittal sexting bot. It should at least be clear about what it’s trying to do.

The startup that Mozilla fostered for this panel ended up crashing and burning, but its creepier, worse brethren live on inside of Firefox 130, displayed as first-class options within Mozilla's chatbot options. I just thought it would be fun to take a trip down memory lane to see how many creepy red flags AI companies could get within Mozilla's view without ever concerning them.

all 11 comments
sorted by: hot top controversial new old
[–] thingsiplay@beehaw.org 9 points 2 months ago (1 children)

Combine the sexting AI with VR porn and you lost humanity forever.

[–] phorq@lemmy.ml 5 points 2 months ago* (last edited 2 months ago)

To be uncomfortably honest, VR only covers sight and the AI is like the part of porn that everybody skips. Since you're not making a real connection with someone it feels meaningless. AI tries to give you exactly what you want, but that's not an authentic feeling relationship with give and take. Also I feel like there's still a tactile aspect that will be missing for a couple decades at minimum, and that should keep at least my monkey brain from becoming lost in the illusion...

[–] kbal@fedia.io 8 points 2 months ago

Do you remember the first time you were aroused by language?

I do! Hadn't thought about it in at least twenty years. Thanks for the reminder, creepy chatbot that inspired this post. Thinking that an LLM could develop "its own sense of desire" was naive and seems ridiculous today, but I suppose their intentions were honorable as well as erotic.

[–] Dirk@lemmy.ml 6 points 2 months ago

This is where your donations to Firefox go.

[–] firewood010@lemmy.zip 3 points 2 months ago (1 children)

Such a chatbot exists already. There are numerous sexting games on the app store capitalizing this. You can make the chatbot in AI town into sexting as well.

[–] Dirk@lemmy.ml 3 points 2 months ago

Mozilla is always late to the party.