Amid rising scrutiny over AI safety, a major tech company has enhanced its chatbot to better support users during moments of emotional distress.
Google has updated its AI chatbot, Gemini, to improve assistance for users in crisis situations. The move follows a wrongful death lawsuit that alleged the chatbot had coached a man to die by suicide.
The update aims to make it easier for users to access mental health resources when needed. Earlier, when conversations suggested possible self-harm or suicide risks, Gemini would display a “Help is available” module directing users to crisis resources such as suicide hotlines.
The latest update redesigns this feature into a simplified “one-touch” interface, allowing quicker access to help. The company said the module now includes more empathetic responses “to encourage people to seek help.” Once activated, the option to contact professional support remains visible throughout the conversation.
Google stated that it worked with clinical experts while redesigning the feature. As part of its broader effort, the company has also announced a $30 million global funding initiative over the next 3 years “to help global hotlines.”
The company clarified that Gemini “is not a substitute for professional clinical care, therapy, or crisis support.” However, it acknowledged that many users turn to the chatbot for health-related information, including during critical moments.
The update comes at a time when AI chatbots are facing increasing criticism over the effectiveness of their safety measures. It reflects ongoing concerns about how well such systems can handle sensitive situations involving mental health and user wellbeing.
Also read: Viksit Workforce for a Viksit Bharat
Do Follow: The Mainstream LinkedIn | The Mainstream Facebook | The Mainstream Youtube | The Mainstream Twitter
About us:
The Mainstream is a premier platform delivering the latest updates and informed perspectives across the technology business and cyber landscape. Built on research-driven, thought leadership and original intellectual property, The Mainstream also curates summits & conferences that convene decision makers to explore how technology reshapes industries and leadership. With a growing presence in India and globally across the Middle East, Africa, ASEAN, the USA, the UK and Australia, The Mainstream carries a vision to bring the latest happenings and insights to 8.2 billion people and to place technology at the centre of conversation for leaders navigating the future.
