Artificial intelligence (AI) has made a significant leap with the introduction of “computer use” in Claude 3.5 Sonnet, the AI model developed by Anthropic. This new feature allows Claude to interact with computers in a way that’s similar to how a person would: observing the screen, moving the cursor, clicking buttons, and typing text.
This capability, still in beta, is available to developers through the APIAn API stands for “Application Programming Interface”… provided by Anthropic. Companies like Asana, Canva, Cognition, DoorDash, Replit, and The Browser Company are already exploring its potential to automate complex processes that require multiple steps.
The implementation of “computer use” represents a paradigm shift in how AIs interact with software, moving from specific tools to general computing skills. This opens the door to a wide range of applications that were previously not possible with current AI assistants.
However, Anthropic acknowledges that this functionality is still experimental and may present bugs. The company is working on safety measures to prevent misuse, such as command injection attacks, and recommends that developers test “computer use” in controlled environments.
With this innovation, Anthropic positions itself at the forefront of developing AI capable of performing complex tasks autonomously, marking a milestone in the evolution of artificial intelligence and its integration into everyday activities.