Anthropic is letting Claude AI control your PC

Anthropic's latest development gives its Claude AI assistant the ability to control a PC, reportedly just like a person would. The feature, dubbed 'computer use,' entered public beta today. With computer use, Claude can be directed to execute tasks such as "looking at a screen, moving a cursor, clicking buttons, and typing text," according to the company's announcement.

We've built an API that allows Claude to perceive and interact with computer interfaces.

This API enables Claude to translate prompts into computer commands. Developers can use it to automate repetitive tasks, conduct testing and QA, and perform open-ended research. pic.twitter.com/eK0UCGEozm

— Anthropic (@AnthropicAI) October 22, 2024

In theory, this could make the AI even more useful in automating repetitive computer tasks. However, a second blog post focused on computer use acknowledged that this application of Anthropic's AI models is still early in development and ...