243
Why AI detectors think the US Constitution was written by AI
(arstechnica.com)
This is a most excellent place for technology news and articles.
As expected, they can't be trusted. And the more AI evolves, the less likely AI content will be detectable IMO.
It will almost always be detectable if you just read what is written. Especially for academic work. It doesn't know what a citation is, only what one looks like and where they appear. It can't summarise a paper accurately. It's easy to force laughably bad output by just asking the right sort of question.
The simplest approach for setting homework is to give them the LLM output and get them to check it for errors and omissions. LLMs can't critique their own work and students probably learn more from chasing down errors than filling a blank sheet of paper for the sake of it.
In many cases they can. This is commonly used to improve their performance: https://arxiv.org/abs/2303.11366
*accurately
Whoops, meant to say: "In many cases, they can accurately (critique their own work)". Thanks for correcting me!