microsoft

Hybrid Computer Use — Design skill for Claude Code

Design community

Official code for "Hybrid Computer Use: A Unified Programmatic, Semantic, and Visual Interface for General Agents".

How to install Hybrid Computer Use

This entry records only its repository, not the path inside it, so there is no exact command to give. Open microsoft/Hybrid-Computer-Use and copy the folder into ~/.claude/skills/, or the file into ~/.claude/agents/.

What Hybrid Computer Use does

Official code for "Hybrid Computer Use: A Unified Programmatic, Semantic, and Visual Interface for General Agents".

Alternatives in Design

Brand Guidelines — Apply Anthropic's official brand colors and typography to artifacts 94.1k ★
Weather Orchestrator Command — Fetch the current temperature for Dubai, UAE and create a visual SVG weather card 20.2k ★
NotebookLM Automation — Complete programmatic access to Google NotebookLM—including capabilities not exposed in the web UI 6.8k ★

README

Hybrid Computer Use

A Unified Programmatic, Semantic, and Visual Interface for General Agents

[Haoqing Wang](https://github.com/hqhq1025)1* · Xiaoyi Zhang1† · Sicheng Fan2 · Zhexin Zhang3 · Xinjie Zhang1 · Jiahao Li1 · Bin Li1 · Yan Lu1

1Microsoft Research 2Fudan University 3Tsinghua University

[![Project Page](https://img.shields.io/badge/%F0%9F%8C%90-Project%20Page-0078D4)](https://microsoft.github.io/Hybrid-Computer-Use/) [![Paper](https://img.shields.io/badge/paper-PDF-b31b1b)](paper/Hybrid-Computer-Use.pdf) [![CI](https://github.com/microsoft/Hybrid-Computer-Use/actions/workflows/ci.yml/badge.svg)](https://github.com/microsoft/Hybrid-Computer-Use/actions/workflows/ci.yml) ![Go 1.22+](https://img.shields.io/badge/go-1.22%2B-00ADD8?logo=go&logoColor=white) ![Platforms](https://img.shields.io/badge/platforms-Linux%20%7C%20macOS%20%7C%20Windows-lightgrey) [![License: MIT](https://img.shields.io/badge/license-MIT-blue)](LICENSE)

[Paper](paper/Hybrid-Computer-Use.pdf) · [Results](#results) · [See it work](#see-it-work) · [How it works](#how-it-works) · [Quick start](#quick-start) · [Docs](docs/README.md) · [Citation](#citation)

An agent operates a computer through three channels: semantic AX, visual GUI, and programmatic code or CLI. The animation switches between the channels.

**Hybrid Computer Use (HCU)** is an open-source MCP server, `computer-use`, that lets coding agents such as Codex, Claude Code, Gemini CLI, and Grok Build operate Linux, macOS, and Windows desktops. It adds two tools, `AX` and `GUI`, next to the agent's own shell and file tools, so the agent picks the right channel at each step: