Google’s AI Overviews feature has once again drawn criticism after it was found sharing incorrect medical information. According to a report, the Mountain View-based technology company’s AI-powered search summaries displayed inaccurate advice when users asked specific medical questions. After the issue became public, the company reportedly removed the response, and AI Overviews no longer appear for certain medical queries.
The issue comes at a time when artificial intelligence adoption in healthcare is being actively promoted by companies such as OpenAI and Anthropic.
An investigation by a publication found that AI Overviews generated incorrect and potentially harmful answers to medical questions on Google Search. In one example, when asked about diet preferences for a person with pancreatic cancer, the AI tool suggested avoiding high-fat food. Medical professionals, however, recommend regular intake of high-fat food, as avoiding it can have fatal outcomes.
In another case, queries related to normal ranges for liver blood tests returned figures that did not account for key factors such as nationality, gender, age or ethnicity. This could lead users to believe their results are normal when they are not. The report also noted that AI Overviews related to women’s cancer tests showed incorrect details, at times “dismissing genuine symptoms.”
A Google spokesperson told the publication that the examples shared were based on incomplete screenshots. The spokesperson added that the cited links were from well-known and reputable sources. A tech outlet also tested the same questions and found that the AI-generated summaries were no longer appearing, a finding also confirmed by the publication in a separate report.
If AI Overviews are providing incorrect medical information, it raises serious concerns, as many users rely heavily on Google Search for health-related guidance. Since AI Overviews appear at the top of search results, users may trust and act on this information without checking other sources.
The development is especially concerning as AI companies continue to push healthcare-focused tools. Even with specialised models designed for medical use, small errors in this field can lead to serious consequences.
Also read: Viksit Workforce for a Viksit Bharat
Do Follow: The Mainstream formerly known as CIO News LinkedIn Account | The Mainstream formerly known as CIO News Facebook | The Mainstream formerly known as CIO News Youtube | The Mainstream formerly known as CIO News Twitter
About us:
The Mainstream is a premier platform delivering the latest updates and informed perspectives across the technology business and cyber landscape. Built on research-driven, thought leadership and original intellectual property, The Mainstream also curates summits & conferences that convene decision makers to explore how technology reshapes industries and leadership. With a growing presence in India and globally across the Middle East, Africa, ASEAN, the USA, the UK and Australia, The Mainstream carries a vision to bring the latest happenings and insights to 8.2 billion people and to place technology at the centre of conversation for leaders navigating the future.
