1300
you are viewing a single comment's thread
view the rest of the comments
[-] CoggyMcFee@lemmy.world 34 points 6 months ago

That’s the thing, it’s not smart. It has no way to know if what it writes is bullshit or correct, ever.

[-] intensely_human@lemm.ee 3 points 6 months ago

When it makes a mistake, and I ask it to check what it wrote for mistakes, it often correctly identifies them.

[-] Silentiea@lemm.ee 5 points 6 months ago

But only because it correctly predicts that a human checking that for mistakes would have found those mistakes

[-] intensely_human@lemm.ee 2 points 6 months ago

I doubt there’s enough sample data of humans identifying and declaring mistakes to give it a totally intuitive ability to predict that. I’m guess its training effected a deeper analysis of the statistical patterns surrounding mistakes, and found that they are related to the structure of the surrounding context, and that they relate in a way that’s repeatable identifiable as “violates”.

What I’m saying is that I think learning to scan for mistakes based on checking against rules gleaned from the goal of the construction, is probably easier than making a “conceptually flat” single layer “prediction blob” of what sorts of situations humans identify mistakes in. The former takes fewer numbers to store as a strategy than the latter, is my prediction.

Because it already has all this existing knowledge of what things mean at higher levels. That is expensive to create, but the marginal cost of a “now check each part of this thing against these rules for correctness” strategy, built to use all that world knowledge to enact the rule definition, is relatively small.

[-] CoggyMcFee@lemmy.world 1 points 6 months ago

That is true. However, when it incorrectly identifies mistakes, it doesn’t express any uncertainty in its answer, because it doesn’t know how to evaluate that. Or if you falsely tell it that there is a mistake, it will agree with you.

this post was submitted on 27 Dec 2023
1300 points (95.9% liked)

Microblog Memes

4726 readers
2457 users here now

A place to share screenshots of Microblog posts, whether from Mastodon, tumblr, ~~Twitter~~ X, KBin, Threads or elsewhere.

Created as an evolution of White People Twitter and other tweet-capture subreddits.

Rules:

  1. Please put at least one word relevant to the post in the post title.
  2. Be nice.
  3. No advertising, brand promotion or guerilla marketing.

Related communities:

founded 1 year ago
MODERATORS