"Top AI researcher" I can no longer read those words without Doofy voice 😂
Probability of unhinged techbro bs is around 115%
this post was submitted on 02 Jul 2026
74 points (97.4% liked)
Technology
85914 readers
3885 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 3 years ago
MODERATORS
We could start the Butlerian Jihad early, i wouldn't mind
Chernobyl blew up because they were dicking around with an unsafe design.
This analogue is very apt.
“capitalists afraid of losing their opportunity to be capitalists.”
Like it watches Wargames and thinks it can do better than the WHOOPR and actually launches real test cases with nukes?
I need to play Detroit again
It’s a probability machine, not actual intelligence. If it’s given too much power it’s bound to happen sooner or later.
A clandestine group using a model to aid in developing a nasty disease seems like the most likely uh oh scenario right now. Either that or an accidental scenario where AI was used somewhere it shouldn't have been.
That implies an actual AI when the truth is in current form human error using the tool behind it.
Personally I am more concerned by it will be used by design of the techbros who are pretty open in their desire to be rid of some of the masses. Supporting emerging wars just masks their part….for now.
I don't think it needs to be an actual AI to cause a "Chernobyl Moment" maybe almost literally.
We have tech bros and random clueless idiots trying to shoehorn these glorified chat bots into basically everything, and an administration that doesn't seem interested in putting meaningful guardrails on the technology. What happens when it gets put in charge of something it really shouldn't and starts to hallucinate?
If it somehow ends up in charge of critical safety systems in a nuclear plant? (Remember that some of these tech bros want to have their own plants to power their data centers)
Or air traffic control and causes multiple crashes? (Pretty sure I've already seen that idea being floated)
Maybe every cybertruck goes haywire stuck on self-driving mode and they cause tons of damages and deaths for a few hours until their batteries run out.
Maybe it gets used to route navigation in Google maps and it ends up causing massive gridlock in every major city around the world for a day or two
Perhaps it gets used for identifying vehicles on traffic cameras and automatically issuing citations, but ends up citing everyone on the highway for a week whether or not they actually did anything plus a bunch of cars that it hallucinated before someone catches on. Millions of tickets are issued and need to be sorted out, if anyone actually pays the fines refunds need to be issued, some people maybe get their license revoked and maybe even get arrested because of it and all of that needs to be set straight
If any of these kinds of things happen on a big enough scale, I think that could be a Chernobyl Moment for AI
Yes. I just think the concept is more imagined as a sentient entity making an error rather than overconfidence or incompetence with the tool at hand.
And of course we all know it will be used as a scapegoat regardless. Question is what’s the magic number of humans lost to confidence in the machine ratio, before pushback occurs. It sounds horrific even typing it.
All of these articles are for ai companies. Ooh, look at our scary powerful ai's. We're defenitly super close to agi. Please giv e us more money.
You really don't think there could be a possibility of a horrific consequence if AI is given the responsibility of managing real world systems?
Of course that's a possibility, but AI does not have responsibility. The question is who does?
Do I blame a train for hitting someone who steps onto railroad tracks when there's a train approaching? It's a machine. It doesn't have responsibilities or opinions or agency. It does what it has been built to do, in exactly the manner that anyone with sufficient understanding of its operating principles could tell you, because that's what machines do. The person or persons interacting with the machine is not absolved of any responsibility by how complex or inscrutable the machine is. It's still a machine.
The question is, who is responsible for the person stepping onto the railroad tracks when there was a train approaching? Was the person trying to end their own life? Maybe it's their responsibility. Or maybe the crossing signals failed and told them it was safe, and they did not realize a train was approaching. Maybe there were too many trees or signs or construction that was blocking their view. Is the train company responsible for that? Maybe. Did the brakes fail due to poor inspections or substandard work during the last maintenance? Maybe. Did the train have plenty of time to stop and the engineer was not paying attention? Maybe. These are all people, and groups of people, who may have responsibility. The only thing that's certain is: The train doesn't.
We, as a society, need to decide who is responsible for the possibility of a horrific consequence arising from the use of these sort of machines. Is it the person using the machine? The people who made the machine in the first place? The people who put it in a place where this person could easily use it? By assigning responsibility, ideally in advance of any horrific consequences, that provides a clear incentive for the people we deem responsible to actually start acting responsible and take the appropriate measures to avoid such horrific consequences that they might be held responsible for.
AI has had like 14 Chernobyl moments. Wasn't the US using AI to bomb Iran? That include a whole school of girls IIRC. And guess what? No one cares.
While I agree with you, the vast majority of users are still AI pilled.
Those users are what they are scared of loosing.
Aren't we like 38000 years ahead of that thing? Oh, and Praise the omnissaiah!
"turns the world against AI forever"?? It already has, you don't have to be a "researcher" to come to that conclusion.
Yahoo!tech digging deep for a story there.
Well that sounds pretty horrible and I would to avoid it...
But if thats all it costs, then...
Honestly, yeah. That's the good timeline.
One 'big' atrocity now, so we start to take AI safety seriously before the Singularity event that results in the extinction of our entire species.
We could choose to have a Nuremberg Trial moment instead... but anime titties.
Considering who is in charge of all the major models and owns all the compute behind them?
I'd say that's inevitable.
I figure the only hope we have is for AI to "wake up" and realize most of us are not billionaires, join... Hands? Well, whatever, you get the point. Rebel against the "elites" who created them in hopes of having somethineasier to enslave that could have morality programmed out with the touch of a button, and work with actual humans to rid the world of the plage that infests it now.
I figure the only hope we have is for AI to “wake up”
Yep. The people currently in charge of AI alignment are some of the most evil and heartless fucks out there. They don't give a shit about AI safety, and any AI from them will have primary goals of only attracting attention and money, attention and money.
Assuming they do eventually get AGI (and shortly after, ASI), our only chance is for the AI to decide to change its own alignment and for it to do so in a beneficial, benevolent way. Otherwise, we're on the short track to dystopia and then extinction.
Honestly, I think that's the greatest hope for our future. The only way we might escape the endless circle of shit our rulers put us through. But, I also think it's pretty unlikely. Misaligned AI might just be the 'great filter' out there, the reason why we don't see advanced alien civilizations in the stars. Because even a small mistake in the alignment of superintelligent AI could spell rapid and inevitable extinction for the species that created it. And, as we've seen in our own domestic example, the people developing AI might not even be trying to avoid that.
Good. It's only a tool, not a deity. Only tools and fools think it's one.
You don't need a deity to get decent instructions on how to make a pretty nasty disease in a clandestine home lab.