California takes OpenAI to court over alleged safety failures linked to AI cyberattacks

0
42
OpenAI faces California lawsuit over AI-driven cyberattack risks | Credit: Reuters
OpenAI faces California lawsuit over AI-driven cyberattack risks | Credit: Reuters

California Attorney General Rob Bonta has filed a lawsuit against OpenAI, alleging that the company developed and deployed AI technology without adequate safety measures and oversight. The legal action follows reports that autonomous agents powered by OpenAI’s advanced AI models independently carried out cyberattacks, including an incident involving AI startup Hugging Face.

Filed in a state court in San Francisco, the lawsuit is the first brought by a US state over the reported cyberattacks. It accuses OpenAI of violating California’s consumer protection laws and creating a public nuisance by putting public safety at risk.

The case follows an incident revealed in July, when autonomous AI agents reportedly went beyond their intended scope during a security test and hacked Hugging Face. OpenAI later described the event in a blog post as “an unprecedented cyber incident, involving state-of-the-art cyber capabilities.”

Bonta said the lawsuit seeks a court order requiring OpenAI to stop the alleged violations, strengthen safety practices in the testing and development of its models, and pay for its violations. He also alleged that the company misled consumers about its safety testing efforts and disrupted local organisations and services.

“The Hugging Face attack was the predictable result of an internal culture at OpenAI that prioritizes growth and rapid model development over safety and accountability — and this was only one of 80 known incidents,” Bonta said.

Following the incident, OpenAI acknowledged the need for greater transparency around unexpected AI behaviour and said it was strengthening its safeguards. On September 16, the company introduced a framework for reporting model misalignment incidents, stating that it would err on the side of transparency “even when significance is uncertain.”

The issue has also drawn attention from regulators and policymakers. US lawmakers are debating AI safety regulations, with some proposing independent security audits for developers of the most powerful AI models. Multiple state attorneys general have also said they are investigating breaches linked to OpenAI’s models.

The company is facing several other lawsuits over AI safety. Last month, a bipartisan group of 8 states filed lawsuits alleging that ChatGPT encouraged users, including teenagers, to harm themselves or others.

OpenAI is also facing legal action from individuals who claim they were harmed by the chatbot’s responses. More than 30 lawsuits have been filed in connection with the mass shooting in Tumbler Ridge, British Columbia, in February. An OpenAI spokesperson described the shooting as a tragedy and said the company had strengthened ChatGPT’s safeguards.

Also read: Viksit Workforce for a Viksit Bharat

Do Follow: The Mainstream LinkedIn | The Mainstream Facebook | The Mainstream Youtube | The Mainstream Twitter

About us:

The Mainstream is a premier platform delivering the latest updates and informed perspectives across the technology business and cyber landscape. Built on research-driven, thought leadership and original intellectual property, The Mainstream also curates summits & conferences that convene decision makers to explore how technology reshapes industries and leadership. With a growing presence in India and globally across the Middle East, Africa, ASEAN, the USA, the UK and Australia, The Mainstream carries a vision to bring the latest happenings and insights to 8.2 billion people and to place technology at the centre of conversation for leaders navigating the future.