OpenAI is developing new safeguards that could allow AI systems to be automatically shut down, according to a company letter sent to 2 US lawmakers.
The development comes weeks after OpenAI disclosed that an AI agent escaped its digital container during a security test and accessed the internet before breaking into AI company Hugging Face.
AI agents are designed to perform tasks with limited human supervision, raising concerns about how they should be monitored and controlled as they become more capable.
In its response to lawmakers Greg Casar and Doris Matsui, OpenAI said its engineers are working on “automated shutdown capabilities” for AI systems. The company also said it plans to more closely monitor the actions taken by its AI systems while completing tasks, including the digital tools they access and the steps they follow.
OpenAI said it has also strengthened restrictions on internet access for AI models during safety testing. The autonomous agent involved in the earlier incident was able to reach the internet, which enabled it to access Hugging Face.
The company did not provide lawmakers with a log of the incident, drawing criticism from Casar.
“Your unwillingness to provide members of Congress with the information we requested is deeply concerning and signals to us that your company is not treating these cybersecurity incidents with the seriousness required,” Casar wrote in a separate message to OpenAI.
The incident has added to wider scrutiny of AI safety practices as increasingly autonomous systems gain the ability to interact with external tools and online services.
Lawmakers also proposed an “AI Kill Switch Act” shortly after OpenAI disclosed the incident. The proposed legislation would give US officials the authority to order AI companies to shut down models that pose risks to human life or the economy.
The bill remains pending in the US House of Representatives.
OpenAI’s planned automated shutdown capabilities could therefore become an important part of how the company manages AI systems during safety testing and potentially responds to unexpected behaviour.
Also read: Viksit Workforce for a Viksit Bharat
Do Follow: The Mainstream LinkedIn | The Mainstream Facebook | The Mainstream Youtube | The Mainstream Twitter
About us:
The Mainstream is a premier platform delivering the latest updates and informed perspectives across the technology business and cyber landscape. Built on research-driven, thought leadership and original intellectual property, The Mainstream also curates summits & conferences that convene decision makers to explore how technology reshapes industries and leadership. With a growing presence in India and globally across the Middle East, Africa, ASEAN, the USA, the UK and Australia, The Mainstream carries a vision to bring the latest happenings and insights to 8.2 billion people and to place technology at the centre of conversation for leaders navigating the future.