83
Schools are using AI counselors to track students’ mental health. Is it safe?
(www.theguardian.com)
"We did it, Patrick! We made a technological breakthrough!"
A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.
AI, in this case, refers to LLMs, GPT technology, and anything listed as "AI" meant to increase market valuations.
Why is the opening story so vague? Middle school counselor gets an automated alert, calls parent, calls police??? No explanation of what caused the alert? Is this supposed to be presented as a success? Then it says "She believes that the interaction built trust between [counselor] and the family."
And other monitoring systems "which would refer the student to in-school suspension " for... reporting "my mom beat me with a pole" or "my uncle touches me"?? I'm so confused by all of this. I don't use AI at all, and never touched AI therapy. I must be so far out-of-the-loop. None of this makes sense.
Yeah, I would definitely feel less safe talking to the AI rat