Cua: Open-Source Computer-Use Infrastructure & Drivers for AI Agents

The landscape of AI-assisted software development is undergoing a fundamental evolution. For the past two years, AI coding assistants have operated almost entirely inside terminal buffers and text editors. However, practical software engineering tasks frequently require interacting with graphical user interfaces: verifying layout behavior in browsers, inspecting spreadsheet data, configuring desktop virtualization tools, or triaging issues across native desktop applications.

This evolution is known as Computer-Use 2.0-a paradigm where an AI agent dynamically navigates between executing shell scripts, calling REST APIs, and operating graphical applications within a single task lifecycle. Until now, developers building computer-use agents faced severe hurdles: OS-level GUI drivers were brittle, headless environments lacked display servers, and agents frequently hijacked the developer's physical mouse cursor. Cua ( trycua/cua ) is an open-source infrastructure platform designed from the ground up to solve these challenges. Here is a comprehensive breakdown of Cua's architecture, its cross-OS desktop drivers, sandboxed cloud fleets, and how it connects to modern AI agents.

The Architecture of Cua

Cua does not attempt to be another monolithic AI agent. Instead, it acts as the operating system and automation layer that any AI agent or model can plug into.

┌─────────────────────────────────────────────────────────────┐
│AI Agents & Models (Claude Code, Cursor, Codex, CUA-S1)│
└──────────────────────────────┬──────────────────────────────┘
│ (CLI / MCP / Typed SDKs) ▼
┌─────────────────────────────────────────────────────────────┐
│Cua Driver │
│ (Background event delivery for macOS, Windows, Linux) │
└──────────────────────────────┬──────────────────────────────