this post was submitted on 13 Jan 2026
333 points (98.0% liked)

Technology

84567 readers
3725 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
 

Website operators are being asked to feed LLM crawlers poisoned data by a project called Poison Fountain.

The project page links to URLs which provide a practically endless stream of poisoned training data. They have determined that this approach is very effective at ultimately sabotaging the quality and accuracy of AI which has been trained on it.

Small quantities of poisoned training data can significantly damage a language model.

The page also gives suggestions on how to put the provided resources to use.

you are viewing a single comment's thread
view the rest of the comments
[–] vacuumflower@lemmy.sdf.org 13 points 4 months ago (14 children)

If, suppose, I were optimistic over this technology, but pessimistic over its current stage of development, I'd expect this to be a cure. It's a problem they'll have to solve. A test they'll have to pass.

If somewhere inside those things someone makes a mechanism building a graph of syllogisms, no kind of poisoned input data will be able to hurt them.

So - this is a good thing, but when people say it's a rebellion, it's not.

[–] FlashMobOfOne@lemmy.world 25 points 4 months ago (3 children)

A test they’ll have to pass.

This makes me chuckle, as they invented euphemisms like 'hallucinations' because their LLM models can't do what they promise. Fabulous marketing, but clearly they didn't do enough testing.

[–] Bazoogle@lemmy.world 4 points 3 months ago (1 children)

as they invented euphemisms like ‘hallucinations’

Seems like a pretty accurate word to use, no? Could also use fabrication, concoction, phantom, or something else? I think "lie" and its synonyms are not accurate, since that requires intent. Since the LLM does not have intent, it cannot "lie".

[–] GamingChairModel@lemmy.world 12 points 3 months ago

That's why "bullshit," as defined by Harry Frankfurt, is so useful for describing LLMs.

A lie is a false statement that the speaker knows to be false. But bullshit is a statement made by a speaker who doesn't care if it's true or false.

load more comments (1 replies)
load more comments (11 replies)