Technology

If I had an employee that fucked up as often and confidently as LLMs do, I would terminate their employment. I don’t have the time or patience to redo all their work because I can’t trust them. If a brand had quality issues at as high a rate as LLM output, I would avoid buying anything related to that brand.

A human being or company can make some amount of mistakes and that’s completely understandable, and I think it’s perfectly fair to hold LLMs to that standard. That said, with a human being I can stress how important some task is and they don’t double or triple check their when it is that important, I can not and will not trust them. If I tell a company “hey this is important to me”, they will usually make extra effort to make sure it’s correct, and if they fail to do so, a decent company will make an extra effort to make things right. An LLM will offer an empty apology and spew more bullshit at me that I still have to verify.

The fact that AI gets things right often enough for you is great. Maybe I have higher standards, maybe I need higher quality output, or maybe I have trust issues. Everyone has a different threshold. Just because yours is much different than the people here doesn’t mean their opinions are invalid, and the way you dismiss everyone’s opinions and insist that it’s good enough makes you seem just as insufferable and ignorant as you accuse others of being.

The fact that LLM output has improved is great, but it is still so far from meeting much less exceeding my threshold that it’s beyond frustrating to keep being told over and over that “no bro, it’s good now”. I’ve been hearing that for over two years and it’s still not close to where I would trust it to answer questions, much less perform actions on my computer with access to my personal data.

You need to learn that some people are different than you and understand where they’re coming from if you want to have an “interesting discussion… about this topic”, rather than getting frustrated that people don’t agree with you and rage quitting.

half the time

Who said all the time? The problem is most people can't tell which half it's fucking up. An unreliable tool isn't useful

That is what people have said, every day, on repeat, for the last three years. Explain why it is better now instead of three months ago, when it was definitely not fucking up all the time and then I will copypaste that back to you for what was said three months ago for the same question.

Which standards are you gonna hold it to? The benchmarking involves using standardized testing, but they typically just feed those questions into the testing data, so the tests have to be constantly updated, and when they are, you will not be surprised to learn that the machines goes back to fucking up the answers all the time.

Experts in their fields do not use this shit because it is wrong on the things they know, but, oh wow, it must be totally right about the things I don't know anything about? Every time.