Microsoft enabled a new “computer use” functionality for Copilot Studio this week, that enables AI agents to communicate with desktop programs and websites. Businesses will be able to utilize Copilot Studio to create AI agents that approach websites and desktop programs as though they are tools for task automation, much like OpenAI’s Operator or Claude’s similarly called “computer use” function.
“Computer use enables agents to interact with websites and desktop apps by clicking buttons, selecting menus, and typing into fields on the screen,” explains Charles Lamanna, corporate vice president of Microsoft’s business & industry Copilot. “This allows agents to handle tasks even when there is no API available to connect to the system directly. If a person can use the app, the agent can too.”
AI agents that can handle bills, do market research, and automate data entry may be created with Copilot Studio. According to Microsoft, this new technology will even recognize when buttons and displays in applications or webpages change and keep functioning without malfunctioning or breaking.
Earlier this month, Microsoft introduced Actions, a comparable feature, to its consumer Copilot. While working on other activities, actions can be carried out in the background. Copilot can now make reservations at restaurants, buy tickets to events, and make purchases from internet retailers. However, the Actions experience is restricted to a few partners, and it appears that Copilot Studio will be open to working with other websites and applications.
Also read: Viksit Workforce for a Viksit Bharat
Do Follow: The Mainstream formerly known as CIO News LinkedIn Account | The Mainstream formerly known as CIO News Facebook | The Mainstream formerly known as CIO News Youtube | The Mainstream formerly known as CIO News Twitter |The Mainstream formerly known as CIO News Whatsapp Channel | The Mainstream formerly known as CIO News Instagram
About us:
The Mainstream formerly known as CIO News is a premier platform dedicated to delivering latest news, updates, and insights from the tech industry. With its strong foundation of intellectual property and thought leadership, the platform is well-positioned to stay ahead of the curve and lead conversations about how technology shapes our world. From its early days as CIO News to its rebranding as The Mainstream on November 28, 2024, it has been expanding its global reach, targeting key markets in the Middle East & Africa, ASEAN, the USA, and the UK. The Mainstream is a vision to put technology at the center of every conversation, inspiring professionals and organizations to embrace the future of tech.
