this post was submitted on 30 Jun 2025
98 points (100.0% liked)

TechTakes

2003 readers
223 users here now

Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.

This is not debate club. Unless it’s amusing debate.

For actually-good tech, you want our NotAwfulTech community

founded 2 years ago
MODERATORS
top 35 comments
sorted by: hot top controversial new old
[–] Architeuthis@awful.systems 28 points 5 hours ago (6 children)

Liuson told managers that AI “should be part of your holistic reflections on an individual’s performance and impact.”

who talks like this

[–] Saleh@feddit.org 9 points 2 hours ago

By creating a language only they are able to speak and interpret, the managerial class is protecting its existence and self reproduction, while keeping people of other classes out or only let them in after passing through a proper reeducation camp, e.g. MBA program.

[–] TinyTimmyTokyo@awful.systems 10 points 4 hours ago

I have no doubt that a chatbot would be just as effective at doing Liuson's job, if not moreso. Not because chatbots are good, but because Liuson is so bad at her job.

[–] thesystemisdown@lemmy.world 7 points 4 hours ago

Some C-Suite executives that think they're important/interesting enough to hold a Ted Talk. Usually it's just buzzword babble, but it occasionally escalates.

[–] dgerard@awful.systems 11 points 5 hours ago (1 children)

imagine Sephiroth writing business books

[–] SinkingLotus@lemmy.world 2 points 21 minutes ago

Wouldn't let him near any books. Dude always destroys the spine.

[–] subterfuge@lemmy.world 10 points 5 hours ago

An AI chatbot, that’s who

[–] bluGill@fedia.io 7 points 5 hours ago

Hr. Somehow this is considered acceptable speach in those formal circles.

[–] HedyL@awful.systems 25 points 5 hours ago (4 children)

FWIW, I work in a field that is mostly related to law and accounting. Unlike with coding, there are no simple "tests" to try out whether an AI's answer is correct or not. Of course, you could try these out in court, but this is not something I would recommend (lol).

In my experience, chatbots such as Copilot are less than useless in a context like ours. For more complex and unique questions (which is most of the questions we are dealing with everyday), it simply makes up smart-sounding BS (including a lot of nonexistent laws etc.). In the rare cases where a clear answer is already available in the legal commentaries, we want to quote it verbatim from the most reputable source, just to be on the safe side. We don't want an LLM to rephrase it, hide its sources and possibly introduce new errors. We don't need "plausible deniability" regarding plagiarism or anything like this.

Yet, we are being pushed to "embrace AI" as well, we are being told we need to "learn to prompt" etc. This is frustrating. My biggest fear isn't to be replaced by an LLM, not even by someone who is a "prompting genius" or whatever. My biggest fear is to be replaced by a person who pretends that the AI's output is smart (rather than filled with potentially hazardous legal errors), because in some workplaces, this is what's expected, apparently.

[–] rebelsimile@sh.itjust.works 1 points 49 minutes ago

Even in code it’s only “right” a small percentage of the time if you count “right” as being able to get the answer quickly, accurately, without it losing context, and happening in less time than it would if you’d been searching. To me, LLMs are just another way of getting to data, and are about as “right” as Google is by shotgunning literally millions of results at you. You (the human) still have to parse through it all, and choose to do something with it.

[–] Saleh@feddit.org 7 points 2 hours ago

I have the same worries in engineering. We had a presentation of some AI "consultancy" firm that was telling us that now is the time to stop hesitating and start doing with LLMs and gave some examples of companies "they" found in regards to our industry. When i asked, if they know any company that is willing to take the legal risks if their designs turn out hazardous, there was the sound of crickets. And just with that, LLMs are completely useless for any design tasks. If i still have to check the design to be in adherence with all relevant laws, norms and other standards, i might just do the design myself.

That is not to say, that there wouldn't be useful tools that fall into what is called "AI" these days. But these tools are designed for specific purposes, by people who do understand the specific purpose and its caveats.

[–] underscores@lemmy.zip 3 points 2 hours ago

I work with someone who is supposed to be a key person for x kind of product we work with and they very obviously send us AI slop answers. I almost wanted to back out of the project they plan to implement solely because our consultant can't even answer basic questions without passing it through GPT.

[–] paequ2@lemmy.today 18 points 5 hours ago (1 children)

I work in a field that is mostly related to law and accounting... My biggest fear is to be replaced by a person who pretends that the AI’s output is smart

Aaaaaah. I know this person. They're an accountant. They recently learned about AI. They're starting to use it more at work. They're not technical. I told them about hallucinations. They said the AI rarely wrong. When he's not 100% convinced, he says he asks the AI to cite the source.... 🤦 I told him it can hallucinate the source! ... And then we went back to "it's rarely wrong though."

[–] HedyL@awful.systems 12 points 5 hours ago (2 children)

And then we went back to “it’s rarely wrong though.”

I am often wondering whether the people who claim that LLMs are "rarely wrong" have access to an entirely different chatbot somehow. The chatbots I tried were rarely ever correct about anything except the most basic questions (to which the answers could be found everywhere on the internet).

I'm not a programmer myself, but for some reason, I got the chatbot to fail even in that area. I took a perfectly fine JSON file, removed one semicolon on purpose and then asked the chatbot to fix it. The chatbot came up with a number of things that were supposedly "wrong" with it. Not one word about the missing semicolon, though.

I wonder how many people either never ask the chatbots any tricky questions (with verifiable answers) or, alternatively, never bother to verify the chatbots' output at all.

[–] dgerard@awful.systems 7 points 2 hours ago (1 children)

AI fans are people who literally cannot tell good from bad. They cannot see the defects that are obvious to everyone else. They do not believe there is such a thing as quality, they think it's a scam. When you claim you can tell good from bad, they think you're lying.

[–] HedyL@awful.systems 1 points 1 hour ago

That's why I find the narrative that we should resist working with LLMs because we would then train them and enable them to replace us problematic. That would require LLMs to be capable of doing so. I don't believe in this (except in very limited domains such as professional spam). This type of AI is problematic because its abilities are completely oversold (and because it robs us of our time, wastes a lot of power and pollutes the entire internet with slop), not because it is "smart" in any meaningful way.

[–] paequ2@lemmy.today 10 points 5 hours ago (1 children)

never bother to verify the chatbots’ output at all

I feel like this is happening.

When you're an expert in the subject matter, it's easier to notice when the AI is wrong. But if you're not an expert, it's more likely that everything will just sound legit. Or you won't be able to verify it yourself.

[–] HedyL@awful.systems 5 points 5 hours ago

But if you’re not an expert, it’s more likely that everything will just sound legit.

Oh, absolutely! In my field, the answers made up by an LLM might sound even more legit than the accurate and well-researched ones written by humans. In legal matters, clumsy language is often the result of facts being complex and not wanting to make any mistakes. It is much easier to come up with elegant-sounding answers when they don't have to be true, and that is what LLMs are generally good at.

[–] sailor_sega_saturn@awful.systems 36 points 6 hours ago (3 children)

Before LLMs came along no one cared what tools I did or didn't use at work. Hell will freeze over before I let a text predictor write code for me even if that eventually costs me a job. I'm the sort who can't stand any sort of auto-completion or other typing "help", much less spending all my time reviewing LLM output.

[–] Rhaedas@fedia.io 13 points 6 hours ago

LLMs are the next wave of popups here in the second quarter of the 21st century. I've become skilled at removing all the requests to let AI help me in whatever I'm actively doing. I about lost it recently when Excel threw one at me at work. NO, I DON'T WANT YOUR HELP!

Having a better guided search in a help feature I don't mind. But stop pushing it in everything, just have a way to get to it (and have it WORK when I use it!)

[–] fartographer@lemmy.world 8 points 6 hours ago (1 children)

Me: single tear rolls down over my tab complete

[–] bluGill@fedia.io 4 points 5 hours ago

Tap complete got worse when llm replaced the AST for tabs.

[–] doleo@lemmy.one 3 points 6 hours ago (2 children)

even if that eventually costs me a job I mean it's kind of a 'damned both ways' situation, here. Right? Lose your job if you refuse to use it, lose your job if you end up training it how to do your job.

[–] zbyte64@awful.systems 5 points 4 hours ago* (last edited 4 hours ago)

That's just it though, it's not going to replace you at doing your job. It is going to replace you by doing a worse job.

[–] Architeuthis@awful.systems 3 points 4 hours ago

A programmer automating his job is kind of his job, though. That's not so much the problem as the complete enshittification of software engineering that the culture surrounding these dubiously efficient and super sketchy tools seems to herald.

On the more practical side, enterprise subscriptions to the slop machines do come with assurances that your company's IP (meaning code and whatever else that's accessible from your IDE that your copilot instance can and will ingest) and your prompts won't be used for training.

Hilariously, github copilot now has an option to prevent it from being too obvious about stealing other people's code, called duplication detection filter:

If you choose to block suggestions matching public code, GitHub Copilot checks code suggestions with their surrounding code of about 150 characters against public code on GitHub. If there is a match, or a near match, the suggestion is not shown to you.

[–] miguel@fedia.io 12 points 5 hours ago

AI is so ridiculous. I literally asked copilot (ms's ai) to recommend books to me based on some books I like... and most of them didn't exist.

[–] Archangel1313@lemmy.ca 25 points 6 hours ago (2 children)

We should expect some enterprising Microsoft coder to come up with an automated AI agent system that racks up chatbot metrics for them — while they get on with their actual job.

Lol!

[–] Rhaedas@fedia.io 7 points 6 hours ago (1 children)

Even better, going off my view of the marketing AI Everything as an annoying popup, we need AI to fight AI, counter the attempt to ask the user if they'd like to try Copilot by yeeting it off the screen. Everyone likes robot fights.

[–] Steve@startrek.website 1 points 33 minutes ago
[–] doleo@lemmy.one 4 points 6 hours ago

Imagine thinking that MS had that kind of talent onboard.

[–] Rooskie91@discuss.online 11 points 5 hours ago (1 children)

AI isn't optional + AI doesn't help at work = it's okay to slack off at work if you can blame AI

[–] Architeuthis@awful.systems 3 points 4 hours ago (1 children)

Not really possible in an environment were the most useless person you know keeps telling everyone how AI made him twelve point eight times more productive, especially when in hearing distance from the management.

[–] dgerard@awful.systems 2 points 2 hours ago

WE HAD THAT PRECISE FUCKING GUY

[–] Coolbeanschilly@lemmy.ca 5 points 6 hours ago (1 children)

https://futurism.com/commitment-jail-chatgpt-psychosis

Why would I want to use something that can create problems like this?

[–] tlekiteki@lemmy.dbzer0.com 3 points 4 hours ago

The funniest part is Elon Musk and friends have chatbot psychosis and nobody can tell them.