As businesses rapidly adopt autonomous AI systems, weak governance frameworks could soon become a major operational risk. A research firm has warned that 40% of enterprises may demote or completely shut down autonomous AI agents by 2027 after discovering governance failures in live production environments.
The report stated that many organizations are applying the same governance controls to all AI agents, regardless of their autonomy levels or access to enterprise systems. Experts warned that this approach can either over-restrict simpler AI tools or under-control highly autonomous systems, increasing security, compliance and operational risks.
“Agents operate at different autonomy levels and across different trust boundaries,” said Shiva Varma.
The warning comes as enterprises increasingly deploy agentic AI systems capable of retrieving data, generating recommendations, modifying systems, executing workflows and making decisions with limited human supervision.
The report recommended a proportional governance model where oversight becomes stricter as AI systems gain higher autonomy and broader enterprise access.
According to the report, AI agent governance can be divided into 4 levels.
The first level includes “observe” agents that only provide read-only support for tasks such as document summarization, knowledge retrieval and code explanations. Basic controls such as authentication, access restrictions and usage logging are considered sufficient at this stage.
The second level covers “advise” agents that generate recommendations or draft content while humans retain final decision-making authority. Experts warned that these systems can still create risks because employees may place excessive trust in AI-generated outputs.
The third level includes agents capable of executing tasks like updating records, sending communications or modifying systems, but only after human approval. These systems require stronger audit trails and approval workflows.
At the highest level, fully autonomous agents can independently perform actions within defined guardrails while humans monitor outcomes instead of reviewing every action.
Varma said these advanced systems require strict governance measures including continuous monitoring, rollback capabilities, automatic shutdown controls and clear accountability structures.
The report highlights growing concerns that enterprises are deploying AI agents faster than they are building governance, compliance and oversight frameworks needed to manage them safely.
Also read: Viksit Workforce for a Viksit Bharat
Do Follow: The Mainstream LinkedIn | The Mainstream Facebook | The Mainstream Youtube | The Mainstream Twitter
About us:
The Mainstream is a premier platform delivering the latest updates and informed perspectives across the technology business and cyber landscape. Built on research-driven, thought leadership and original intellectual property, The Mainstream also curates summits & conferences that convene decision makers to explore how technology reshapes industries and leadership. With a growing presence in India and globally across the Middle East, Africa, ASEAN, the USA, the UK and Australia, The Mainstream carries a vision to bring the latest happenings and insights to 8.2 billion people and to place technology at the centre of conversation for leaders navigating the future.