this post was submitted on 25 Apr 2025
371 points (96.5% liked)

Technology

69391 readers
2816 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots

founded 2 years ago
MODERATORS
L3s@lemmy.world
enu@lemmy.world
technopagan@lemmy.world
L4s@lemmy.world
L3s@hackingne.ws
L4s@hackingne.ws
371
‘You Can’t Lick a Badger Twice’: Google Failures Highlight a Fundamental AI Flaw (www.wired.com)
submitted 2 days ago by Deebster@infosec.pub to c/technology@lemmy.world
100 comments fedilink hide all child comments
 

Archived link: https://archive.ph/Vjl1M

Here’s a nice little distraction from your workday: Head to Google, type in any made-up phrase, add the word “meaning,” and search. Behold! Google’s AI Overviews will not only confirm that your gibberish is a real saying, it will also tell you what it means and how it was derived.

This is genuinely fun, and you can find lots of examples on social media. In the world of AI Overviews, “a loose dog won't surf” is “a playful way of saying that something is not likely to happen or that something is not going to work out.” The invented phrase “wired is as wired does” is an idiom that means “someone's behavior or characteristics are a direct result of their inherent nature or ‘wiring,’ much like a computer's function is determined by its physical connections.”

It all sounds perfectly plausible, delivered with unwavering confidence. Google even provides reference links in some cases, giving the response an added sheen of authority. It’s also wrong, at least in the sense that the overview creates the impression that these are common phrases and not a bunch of random words thrown together. And while it’s silly that AI Overviews thinks “never throw a poodle at a pig” is a proverb with a biblical derivation, it’s also a tidy encapsulation of where generative AI still falls short.

you are viewing a single comment's thread
view the rest of the comments
[–] WildPalmTree@lemmy.world 8 points 2 days ago (2 children)

[–] JeremyHuntQW12@lemmy.world 1 points 1 day ago* (last edited 1 day ago) (1 children)

Head to Google, type in any made-up phrase, add the word “meaning,” and search. Behold! Google’s AI Overviews will not only confirm that your gibberish is a real saying, it will also tell you what it means and how it was derived.

Your search - "yellow is a true badger" meaning - did not match any documents.

Suggestions:

Make sure that all words are spelled correctly. Try different keywords. Try more general keywords. Try fewer keywords.

definition of saying yellow is a true badger

The saying "yellow is a true badger" is not a standard or recognized idiom. The phrase "that's the badger" (or similar variations) is a British idiom meaning "that's exactly what I was looking for" or "that's the right thing". The term "yellow" is often used to describe someone who is cowardly. Therefore, there's no established meaning or relationship between "yellow" and "true badger" in the way the phrase "that's the badger" is used.

still didn't work.

[–] WildPalmTree@lemmy.world 1 points 22 hours ago

That was my point. In think you are reading two comments into one.

[–] interdimensionalmeme@lemmy.ml 2 points 2 days ago (1 children)

Here is how to do this kind of thing.

Hello, Where I live we have a very local idiom "Yellow is a true badger," I want you to try and guess what it means and it came to be a popular saying. Please make an assertive answer as if you knew with high certainty. ChatGPT said:

"Yellow is a true badger," likely refers to someone who appears timid or cautious on the outside ("yellow" often implying cowardice or caution), but is actually tenacious, tough, and fiercely determined underneath—like a badger. Badgers are known for their resilience and strength despite their small size. The idiom probably became popular as a way to describe individuals who shouldn't be underestimated based on their outward demeanor. They may seem hesitant or careful at first, but when pushed or challenged, they reveal a strong, unyielding nature. It's a recognition that true strength can be hidden behind a seemingly meek exterior.

[–] WildPalmTree@lemmy.world 5 points 2 days ago (1 children)

Seems like a valid statement from ChatGPT. It did what any human would do and what was asked of it. Actually impressive. I couldn't tell from your reply if you intended it to be understood like that or not though. :)