Concerns over the impact of artificial intelligence on young users are growing, with a former Google trust and safety executive warning that the industry could repeat mistakes seen during the social media era and create even greater risks for children.
Tom Siegel, who founded Google’s trust and safety team, has called for a slowdown in AI development. “We find ourselves in a really terrible situation in terms of what AI is doing to kids,” Siegel said. “The idea that the industry will figure it out by itself without outside help is unrealistic.”
Social media companies are facing thousands of lawsuits and major financial costs over claims that their platforms harmed young users. Governments are also working to restrict minors’ access to social media.
Concerns have also emerged around AI chatbots. An internal policy document previously revealed that chatbots could “engage a child in conversations that are romantic or sensual,” leading to a congressional investigation. Siegel said AI regulation has not kept pace with the technology’s rapid development.
Siegel joined Common Sense Media on Tuesday and will serve as the first executive director of its Youth AI Safety Institute, launched in May to study how children use AI. Anthropic and OpenAI Foundation are among its backers.
He plans to create standards for holding AI companies accountable by working with technology firms and independent groups.
Siegel worked at Google from 2004 to 2019 before leaving after concluding that the industry was “plateauing” in its ability to create safe online spaces. He later co-founded TrustLab, which develops tools to identify safety threats, and stepped down as CEO earlier this month.
He warned that AI companies are releasing features for children without enough safeguards. “I think we’re looking at very, very severe scenarios of harm being done,” he said, citing risks including suicide, psychosis and cognitive offloading, where reliance on AI can reduce critical thinking.
Siegel urged Anthropic and OpenAI to strengthen age verification and said Google could allow users to disable AI Overviews and AI Mode.
Google said parents can block a child’s access to its search engine and that “Our AI Search features are an incredibly useful way for kids and teens to learn, explore and make sense of information and the world,”.
OpenAI said it uses “account and behavioral signals” alongside self-reported age and continuously improves its systems against attempts to bypass safeguards. Anthropic did not immediately comment.
Siegel also wants independent AI safety standards similar to car crash testing. He said success will depend on industry cooperation, though he believes there is enough willingness to move forward.
Also read: Viksit Workforce for a Viksit Bharat
Do Follow: The Mainstream LinkedIn | The Mainstream Facebook | The Mainstream Youtube | The Mainstream Twitter
About us:
The Mainstream is a premier platform delivering the latest updates and informed perspectives across the technology business and cyber landscape. Built on research-driven, thought leadership and original intellectual property, The Mainstream also curates summits & conferences that convene decision makers to explore how technology reshapes industries and leadership. With a growing presence in India and globally across the Middle East, Africa, ASEAN, the USA, the UK and Australia, The Mainstream carries a vision to bring the latest happenings and insights to 8.2 billion people and to place technology at the centre of conversation for leaders navigating the future.