736
How did they estimate whether an LLM was used to write the text or not? Did they do it by hand, or using a detector?
Since detectors are notorious for picking up ESL writers, or professionally written text as AI-Generated.
this post was submitted on 02 Mar 2025
736 points (98.9% liked)
Science Memes
12579 readers
2973 users here now
Welcome to c/science_memes @ Mander.xyz!
A place for majestic STEMLORD peacocking, as well as memes about the realities of working in a lab.
Rules
- Don't throw mud. Behave like an intellectual and remember the human.
- Keep it rooted (on topic).
- No spam.
- Infographics welcome, get schooled.
This is a science community. We use the Dawkins definition of meme.
Research Committee
Other Mander Communities
Science and Research
Biology and Life Sciences
- !abiogenesis@mander.xyz
- !animal-behavior@mander.xyz
- !anthropology@mander.xyz
- !arachnology@mander.xyz
- !balconygardening@slrpnk.net
- !biodiversity@mander.xyz
- !biology@mander.xyz
- !biophysics@mander.xyz
- !botany@mander.xyz
- !ecology@mander.xyz
- !entomology@mander.xyz
- !fermentation@mander.xyz
- !herpetology@mander.xyz
- !houseplants@mander.xyz
- !medicine@mander.xyz
- !microscopy@mander.xyz
- !mycology@mander.xyz
- !nudibranchs@mander.xyz
- !nutrition@mander.xyz
- !palaeoecology@mander.xyz
- !palaeontology@mander.xyz
- !photosynthesis@mander.xyz
- !plantid@mander.xyz
- !plants@mander.xyz
- !reptiles and amphibians@mander.xyz
Physical Sciences
- !astronomy@mander.xyz
- !chemistry@mander.xyz
- !earthscience@mander.xyz
- !geography@mander.xyz
- !geospatial@mander.xyz
- !nuclear@mander.xyz
- !physics@mander.xyz
- !quantum-computing@mander.xyz
- !spectroscopy@mander.xyz
Humanities and Social Sciences
Practical and Applied Sciences
- !exercise-and sports-science@mander.xyz
- !gardening@mander.xyz
- !self sufficiency@mander.xyz
- !soilscience@slrpnk.net
- !terrariums@mander.xyz
- !timelapse@mander.xyz
Memes
Miscellaneous
founded 2 years ago
MODERATORS
They developed their own detector described in another paper. Basically, this reverse-engineers texts based on their vocabulary to provide an estimate on how much of them were ChatGPT.
load more comments
(1 replies)
They just asked a few people if they thought it was written by an LLM. /s
I mean, you can tell when something is written from ChatGPT, especially if the person isn't using it for editing, but is just asking it to write a complaint or request. It is likely they are only counting the most obvious, so the actual count is higher.
I don't know of any reason that the proportion of ESL writers would have started trending up in 2022.
If it's due to LLM is it "human written communication"?
Human-like written communication.
Even if it was fully AI generated its still human communication in a written format, at least until the AIs start writing to each other without a human intermediary.
I thought there was a social network that is completely filled with AI and no real humans.
Edit: found it https://socialai.co/
https://www.theverge.com/2024/9/17/24247253/social-ai-app-replace-humans-with-bots
is that seriously a website whose sole function is telling you to go to the app store?
Yeah, which is why I included a news article to get a sense of what it is.
Reddit had a subreddit dedicated to bots just posting to each other as well.
/r/subreddit_simulator, IIRC
I think that one used simple Markov chains and was really entertaining for years.
I also remember there was a bot you could summon that would simulate a comment written by you, and it was funny to see those.
Written communication of humans, not by humans
„signs of LLM writing” doesn’t mean that the whole thing was written by it.
This is the top result on duck duck go for how tall does a soursop tree get:
https://livetoplant.com/soursop-plant-size-get-the-right-size-for-you/
Gee thanks, I'm cured.
Btw does any one know if Soursops have an aggressive root system?
I'm jealous you can grow soursop, those things are delicious!
yeah, I've got around 40 trees I've planted in our yard. Thing was, when I bought this, it was labeled as a lychee. Then it started making soursop flowers.
Wow, 40 trees! You must have a big property.
I live in the Pacific northwest, so no tropical fruit for me 😭 we've got good berries and stone fruit here, though.
It sounds like you can opt for a seedling sized plant and you'll be fine!
/s
Well if your books start talking back you should get help. The computer just started getting good (I remember Dr Sbaitso)
That’s scary shit. Hopefully this can slow down some.
Who wants to be licked by an emo?
omg me
Don’t worry, I see you