As reported by Eurogamer, Epic Games CEO Tim Sweeney took to X (formerly Twitter) to criticize an attempt by US lawmakers to ban the social media app and its accompanying generative AI tool, Grok. The move came after users discovered that Elon Musk's Grok has the ability to take photos of real people, including minors, and produce images of them undressed or in otherwise sexually compromising positions, flooding the site with such content.
"Reason #42 for open platforms: to shut down every politician’s incessant demands to all gatekeepers to censor all of their political opponents," Sweeney wrote in a first tweet responding to MacRumors' report of US politicians requesting that Apple and Google remove X and Grok from their app stores.
"All major AIs have documented instances of going off the rails," Sweeney continued in a follow up tweet. "All major AI companies make their best efforts to combat this; none are perfect. Politicians demanding gatekeepers selectively crush the one that's their political opponent's company is basic crony capitalism."
"AI going off 'guardrails' is not the same as actively excusing content for pedophiles," wrote Remap and former Waypoint editor, Patrick Klepek, in response. "Your priorities as someone in charge of a company that makes a video game catering to young people are completely off."
404 Media's report from January 5 at the beginning of this saga offers illustrative examples of Grok's newly-discovered capabilities, like influencers undressed, made to appear pregnant, or shown breastfeeding a child. There are also extensive reports of users generating such material from images of minors.
Theremoved, Abuse, & Incest National Network (RAINN) defines child sexual abuse material (CSAM) as "evidence of child sexual abuse" that "includes both real and synthetic content, such as images created with artificial intelligence tools." One of RAINN's examples of CSAM is "any content that sexualizes or exploits a child for the viewer's benefit."
Since the controversy came to light, the only change X has made has been moving Grok's ability to generate images in tweet replies behind a paywall—X now appears to be more directly profiting off of Grok's ability to generate CSAM than it was in the first place.
This is all particularly galling in the face of the actual politically-motivated censorship Sweeney has overseen on the platform that helps make him a billionaire. Back in December, the Epic Games Store followed Steam's lead in banning the art game, Horses, for hazy reasons, an outgrowth of the pressure placed on payment processing companies by conservative activist groups to censor transgressive art and legal pornography on the internet.
Given the opportunity, Sweeney appears eager to defend an unprecedented online sexual humiliation machine, calling for open platforms and free speech while presiding over censorship on his own, closed platform. Sweeney's follow-up may have the beginnings of a solution, though: "All major AIs have documented instances of going off the rails." If this is what we can expect from such tools, maybe they should all be banned.
LLMs were an independent tool you downloaded and did that shit with on your own computer. Not legal in somewhere like the UK, but not something the government could find anyway.
This is just out there on a major online platform happening thousands of times per hour. Not just the CSAM either but the sexual material of unconsenting people is not legal either.
Ofcom is an independent body empowered to investigate and carry out action here. They are empowered to fine up to 10% of global revenue.
When they are hit and the platform continues to not do something about it, the entire issue will escalate into parliament and given that doing nothing about CSAM existing in the open online is not a political option I suspect a ban will come.
I can only speak for the UK but I suspect a similar situation is playing out in multiple other countries with independent regulatory bodies and govs in a similar situation. Defending CSAM is not a tenable position to stake your name to unlike in the US.
Musk will back down first before this happens imo but we will see.
Counterpoint: this is Nonce Island we're talking about
Noncing for we not for thee plebians!
If people put up CSAM/unconsenting People online that seems like an easy win for the police to me but i am probably just stupid.
I hate x like the next guy but whenever I reported something illegal it was taken down so to me it really seems like an attack on the platform when people start to randomly see that kind of stuff.
Like fuck x, but mostly for their sanctioned Nazi stuff. This porn-shit is not even allowed over there so I ask myself why it is such a big issue right now. I have deleted my account a year ago so i really don't know how the average experience lools right now but I know that especially the UK government looooves censorship and surveillance (like every government but is less afraid to actually do something).
BTW, the filthy people we are outraged about won't just vanish, they will simply smarten up while every normal UK citizen will have to log in with their ID. Sounds cool. Because I don't live there.
Only if X cooperate and they will only cooperate if you can prove the user is from your jurisdiction in the first place.
The police do not have the resources to investigate thousands of violations, they want the platforms to behave responsibly.
Every normal UK citizen will have to pay for VPN or get off the platform because it'll be blocked at the DNS level if it escalates that far. Every influencer will be expected to get off it (and will conform) because staying on a platform banned by the state for CSAM will make them unemployable and persona non grata in UK media. All UK content on the platform will drop off the map and all interest any average person with the will to bypass a ban will disappear because there will be nothing culturally british to interest them on it anymore.
Where will the British go? I don't know. There will be a significant gain of UK users on other platforms though. With any luck it'll see less fash influence within the UK too as it's easily the strongest and most influential fascist promoting platform right now.
Imagine a world where we could end a platform for promotion of fascism instead of conjuring up perverts terrorists every time
If that had happened to chan pre 2012 I suspect a lot of current shit wouldn't be happening. They never should have been allowed a space to find one another scattered in rare isolated spaces distant apart. They never would've been able to organise into an online fringe and that fringe would never have broken into mainstream without that online organising, anarchic and stochastic as it was.
I looked up the situation in the UK yesterday and they had to make a new law for revenge porn and I don't think it would actually covers the nudify AI stuff.
There might be some other legal basis to go after it but honestly not sure.
Morally I don't see why fabricating fake porn of real people would be different from other non consensual pornography but legally it probably is.