this post was submitted on 13 Aug 2026
63 points (89.9% liked)

Technology

87347 readers
266 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS
all 37 comments
sorted by: hot top controversial new old

You know what, good on anthropic!

[–] garretble@lemmy.world 15 points 6 days ago (1 children)

Ah yes, dreaming of an AI novel.

"And what do you want to be when you grow up, Timmy?" "I want to pretend to write stories and then get upset I have to do any work at all."

[–] anon_8675309@lemmy.world 4 points 6 days ago

Two types of “authors”. Those who want to write and those who want to have been a writer. The first enjoys the work. The second only enjoys the spoils.

[–] flamingo_pinyata@sopuli.xyz 8 points 6 days ago (2 children)

If wonder if they will just fill it with non-printable unicode characters. It would be the easiest to implement, and fairly effective for most casual users.

Sure it's trivial to make a tool to strip the text of those characters. But someone would have to be dedicated to cheating to bother.

[–] LastYearsIrritant@sopuli.xyz 6 points 6 days ago

Copy/Paste it into notepad, then copy/paste it from there into whatever else you want it.

That's been the go-to for removing weird characters from text since the beginning of time. You SHOULD do that any time you copy text from any web page to remove any hidden text, or weird formatting.

[–] jdr@lemmy.ml 5 points 6 days ago

Why do people keep suggesting this? It's a moronic idea and they've already said they'll hide it within the word choices.

[–] MangoCats@feddit.it 3 points 6 days ago (1 children)

Hey Claude, save this text in ASCII 0-127 encoding.

[–] LodeMike@lemmy.today 1 points 2 days ago (1 children)

That's not how the watermarking works. It depends on a pattern deviations from statistics throughout a string of tokens.

[–] MangoCats@feddit.it 2 points 2 days ago (1 children)

Don't confuse me with facts! (And, thanks... I have since seen the articles about how it works based on word selection from a subset of the words that would have been randomly selected by the "heat" of the model.)

[–] LodeMike@lemmy.today 1 points 2 days ago (1 children)

I don't know much about it but it sounds like it would only work if you have the weights and maybe the running conditions of the model. Otherwise the statistical wright wouldn't be known.

It also sounds really easy to break by changing random words.

[–] MangoCats@feddit.it 2 points 2 days ago (1 children)

If you dig a little you can get the articles explaining better, but basically: yes, you have to have the weights, and a secret key... Given those, they split the words that might be chosen at each point into two groups and only choose from one group.

Later, you can check for the watermark by splitting the same way and seeing how many times the words in the text match the group that fits with the secret key. Normal text would hit a 50% match, but unlatered AI generated text would hit 100% match, so... somewhere higher than 50 you start to suspect AI involvement, possibly edited, and by the time you get over 99% it's virtually certain that AI had some involvement - particularly if the sampling of words runs into the thousands.

[–] LodeMike@lemmy.today 1 points 2 days ago
[–] gedaliyah@lemmy.world 2 points 6 days ago

Once the technology exists, we need clanker laws.

Make it illegal to generate ML output without a positive watermark.

[–] Leviathan@fedinsfw.app 1 points 6 days ago

They need to do this for all AI images

[–] Ilovethebomb@sh.itjust.works 11 points 1 week ago

Yeah, it's the verbose, waffling, psychophantic tone they all have.

[–] Dyskolos@lemmy.zip 9 points 1 week ago (5 children)

Maybe I'm out of the loop, but how would I watermark a text without sounding obvious? By using weird phrases? They get edited. By using e.g. an exact combination of starting letters over a large paragraph? One changed word and it's broken. And even if not, I could happen to write the same myself, and then?

How am I hiding a signature in Plain text? Anyone got a better idea than my silly ones?

[–] TheBlackLounge@lemmy.zip 14 points 6 days ago (2 children)

By being just a little weird, but in a pattern, and not to you. A pattern like: every n tokens raise the temperature (randomness) for one token. Then to dectect AI, you tokenize and calculate how expected each next token is. Then you try fitting the pattern to that.

[–] First_Thunder@lemmy.zip 6 points 6 days ago (1 children)

Wouldn’t that potentially affect output quality particularly in code/tool calls?

[–] Tetsuo@jlai.lu 1 points 6 days ago (1 children)

To my surprise almost if not all LLM are set not to be deterministic and have one unique input result in always the same output.

They all are set to have a "temperature" setting so that they sound more natural.

Personally I think quality of the output tokens of LLM is surprisingly not as much their priority as the quality and truthfulness of the result.

I would 100% prefer a LLM that is purely deterministic and repeats the same answer exactly to the same question. Instead LLM are constantly choosing the next likely token more TL appear human rather than being accurate.

These LLM are designed as sycophants and set up and trained as such.

So a fingerprinting in the output seems quite realistic. An LLM is not giving you it's best most likely answer. It's taking one of the most likely answer and adds a sprinkle of uncertainty and randomness on top of it so it looks natural...

[–] MangoCats@feddit.it 1 points 6 days ago

I would 100% prefer a LLM that is purely deterministic and repeats the same answer exactly to the same question

Then you don't like your LLM to solve problems, because a lot of how they solve problems is trying, testing, failing, then trying again - getting a different answer and testing that...

[–] Dyskolos@lemmy.zip 3 points 6 days ago (1 children)

Sounds fitting, but we're talking of text with a purpose here. Wouldn't we notice that raise in temp? If I "write" a novel like that I will surely still cross-check it a dozen times, no?

Also I might rephrase a lot, move a lot, and the confidence of the detection would fall.

But, yes, on a long text that I would not touch, that could work pretty reliable.

[–] TheBlackLounge@lemmy.zip 2 points 6 days ago

Lower temperature is not necessarily better quality. At 0 it will get very repetitive, it's for classification tasks, not for prose.

I suppose the optimal temperature depends on the model and the task, and I don't think it's very sensitive. Varying temp might even give better results, who knows.

[–] Meron35@lemmy.world 5 points 6 days ago

The more apt word is steganography, rather than watermark. Basically subtly adjust the weights of the model so that some subtle patterns appear. Think of how AI text prefers certain words and phrases that ordinary humans don't use as often, like "delve," but presumably much more subtle.

And no, as Anthropic has already said, this watermark may not survive editing/formatting.

Claude Now Watermarks Your Text | Vanja Petreski - https://vanja.io/claude-invisible-watermark/

[–] MangoCats@feddit.it 3 points 6 days ago (1 children)

This is reminding me of the old "we're going to watermark our digital music so when you rip it to mp3s we can still tell where it came from..." stuff that was going around in the 1990s.

[–] Dyskolos@lemmy.zip 1 points 6 days ago

And it worked so well 😁 What kinda worked back then were the "copy protection" of games. Like the paper wheels to turn and whatnot.

[–] HaraldvonBlauzahn@feddit.org 1 points 5 days ago

For Example hiding it in the statistical Distribution of word lenghts. Also, such hidden bits can be signed with public keys of the LLM companies.

[–] magnue@lemmy.world 0 points 6 days ago (1 children)

Probably the same way Reddit figures out I'm permabanned even if I remove all traces of my identify during signup.

[–] Dyskolos@lemmy.zip 0 points 6 days ago (1 children)

You probably just only removed all traces of your identity that you can think of 😁 Though, nothing much lost. .

[–] magnue@lemmy.world 2 points 6 days ago (1 children)

I used mullvad browser and mullvad VPN. Both of which I have never used previously. Through this I then created a proton mail account with a username I have never used. Signed up to Reddit with that. There is no link there.

It's possible they banned me just because doing that in itself was just too shady but I'm not sure. Next I'll try buying a karma'd account.

[–] Dyskolos@lemmy.zip 3 points 6 days ago (1 children)

Probably just banned because vpn, especially proton. I can't count the sited I can't visit anymore because of VPN. Even steam asks me questions like WHY am I signing in "like that"...

I'd try another VPN and/or just another fresh browser. One you'd never use anyway. Just to see where's the culprit.

[–] magnue@lemmy.world 3 points 6 days ago

Maybe I'll try some kind of proxy. I have to use something because I'm IP banned for sure.

[–] VibeSurgeon@piefed.social 5 points 1 week ago

Text watermarking is trivially removable, fwiw

[–] Abyssian@lemmy.world 3 points 1 week ago (1 children)

Anthropic just rolled out a tool that'll decimate some people's dreams of writing AI novels undetected

Of course it will. It's not like they'd make a high price membership that would let people white list the things they want to publish so the detector tells everyone they're 100% honest.

[–] Quazatron@lemmy.world 6 points 1 week ago

So, you're telling me that if I want to cheat I should use Chinese models. Got it.