LLMs are terrible at crisis intervention because they hallucinate reassurance. A model telling someone it gets better without real clinical judgment is dangerous. Google should be mandating crisis hotline redirects, not tuning better conversational responses.
this post was submitted on 08 Apr 2026
2 points (75.0% liked)
1957 readers
8 users here now
Welcome to the Google community! This is a place to discuss everything related to Google products, services, features, and discussions.
ChromeOS discussions are welcome!
General discussions about Google products, updates, tips, and related topics are welcome. However, for specific technical support, account-related inquiries, advertising questions, and other issues, please direct them to official Google support channels.
Rules
- Stay on topic: All posts should be related to Google products, services, or the Google ecosystem.
- Respectful discussions: Treat fellow community members with respect and engage in constructive discussions. Avoid personal attacks, harassment, or offensive language.
- No support inquiries: Please refrain from posting individual support inquiries or account-related issues. Use official Google support channels for assistance.
- No spam or self-promotion: Do not post spam or self-promotional content. This includes links to personal websites, blogs, or products/services.
- No illegal content: Do not share or discuss illegal content, including piracy, hacking, or copyright infringement.
- No misleading information: Avoid spreading false or misleading information about Google or its products.
- No inappropriate content: Do not post or link to any inappropriate or NSFW (Not Safe for Work) content.
- No off-topic discussions: Keep the discussions focused on Google products, services, and related topics. Avoid unrelated or off-topic discussions.
- No excessive advertising: Do not excessively promote products, services, or websites.
- Follow community guidelines: Adhere to the overall community guidelines and terms of service.
founded 2 years ago
MODERATORS
Google fixing mental health responses in Gemini sounds like PR cleanup after their model told someone to die. AI models giving mental health advice remains fundamentally dangerous regardless of how they tune the safety filters.
An ad company wants to be your therapist. The irony is not subtle. Gemini has an engagement problem and somebody decided the solution was to monetize mental health alongside the targeted advertising. You cannot harvest data from vulnerable people and call it wellness support.