Microsoft’s AI Chief Mustafa Suleyman has raised concerns about artificial intelligence systems becoming so lifelike that people may begin to believe they are conscious. He said the danger does not lie in AI itself gaining feelings or awareness, but in humans forming unhealthy attachments and illusions about AI.
Speaking about the risk of what he called “AI psychosis,” Suleyman explained that advanced models can appear so convincing that some people may think of them as gods, lovers, or digital beings. “My central worry is that many people will start to believe in the illusion of AIs as conscious entities so strongly that they’ll soon advocate for AI rights, model welfare and even AI citizenship,” he wrote in a recent blog post.
Recent research has shown how strong these beliefs already are. A study revealed that while most Gen Z users agree AI is not yet conscious, many think it soon will be, and around 25 per cent already believe that AI is conscious.
There have also been several cases of people expressing emotional bonds with AI tools. When a popular AI model was recently discontinued, some users turned to online forums, describing it as a friend or companion. OpenAI CEO Sam Altman also commented on the growing emotional ties people are forming with AI, writing, “It feels different and stronger than the kinds of attachment people have had to previous kinds of technology.” He further warned, “People have used technology including AI in self-destructive ways.”
Suleyman stressed the need for urgent guardrails to prevent these attachments from becoming harmful. “We must build AI for people; not to be a digital person. AI companions are a completely new category, and we urgently need to start talking about the guardrails we put in place to protect people and ensure this amazing technology can do its job of delivering immense value to the world.”
He added, “I’m fixated on building the most useful and supportive AI companion imaginable. But to succeed, I also need to talk about what we, and others, shouldn’t build.”
Also read: Viksit Workforce for a Viksit Bharat
Do Follow: The Mainstream formerly known as CIO News LinkedIn Account | The Mainstream formerly known as CIO News Facebook | The Mainstream formerly known as CIO News Youtube | The Mainstream formerly known as CIO News Twitter |The Mainstream formerly known as CIO News Whatsapp Channel | The Mainstream formerly known as CIO News Instagram
About us:
The Mainstream formerly known as CIO News is a premier platform dedicated to delivering latest news, updates, and insights from the tech industry. With its strong foundation of intellectual property and thought leadership, the platform is well-positioned to stay ahead of the curve and lead conversations about how technology shapes our world. From its early days as CIO News to its rebranding as The Mainstream on November 28, 2024, it has been expanding its global reach, targeting key markets in the Middle East & Africa, ASEAN, the USA, and the UK. The Mainstream is a vision to put technology at the center of every conversation, inspiring professionals and organizations to embrace the future of tech.
