Health - Resources and discussion for everything health-related

4261 readers

248 users here now

Health: physical and mental, individual and public.

Discussions, issues, resources, news, everything.

See the pinned post for a long list of other communities dedicated to health or specific diagnoses. The list is continuously updated.

Nothing here shall be taken as medical or any other kind of professional advice.

Commercial advertising is considered spam and not allowed. If you're not sure, contact mods to ask beforehand.

Linked videos without original description context by OP to initiate healthy, constructive discussions will be removed.

Regular rules of lemmy.world apply. Be civil.

founded 2 years ago

MODERATORS

WhoRoger@lemmy.world

RoyalEngineering@lemmy.world

Awa@lemmy.world

ChatGPT Health 'under-triaged' half of medical emergencies in a new study (www.nbcnews.com)

submitted 19 hours ago by MicroWave@lemmy.world to c/health@lemmy.world

25 comments fedilink hide all child comments

Researchers tested different medical scenarios with the chatbot. In more than half of cases in which doctors would send patients to the ER, the chatbot said it was OK to delay care.

ChatGPT Health

OpenAI's new health-focused chatbot

frequently underestimated the severity of medical emergencies, according to a study published last week in the journal Nature Medicine.

In the study, researchers tested ChatGPT Health's ability to triage, or assess the severity of, medical cases based on real-life scenarios.

Previous research has shown that ChatGPT can pass medical exams, and nearly two-thirds of physicians reported using some form of AI in 2024. But other research has shown that chatbots, including ChatGPT, don't provide reliable medical advice.

you are viewing a single comment's thread
view the rest of the comments

[–] jacksilver@lemmy.world 10 points 17 hours ago (1 children)

You're being down voted because LLMs aren't deterministic, it's basically the biggest issue in productizing them. LLMs have a setting called "temperature" that is used to randomize the next token selection process meaning LLMs are inherently not deterministic.

If you se the temperature to 0, then it will produce consistent results, but the "quality" of output drops significantly.

[–] LodeMike@lemmy.today -1 points 16 hours ago

If you give whatever random data source it uses the same seed, it will output the same thing.