24kchengYe

Desktop Controller Skill — Testing skill for Claude Code

Testing community

AI Computer Use for Claude Code — The open-source alternative to OpenAI Codex's playwright-interactive.

How to install Desktop Controller Skill

This entry records only its repository, not the path inside it, so there is no exact command to give. Open 24kchengYe/desktop-controller-skill and copy the folder into ~/.claude/skills/, or the file into ~/.claude/agents/.

What Desktop Controller Skill does

AI Computer Use for Claude Code — The open-source alternative to OpenAI Codex's playwright-interactive. Dual-engine: Win32 API + Playwright. Control WeChat, DingTalk, Feishu, QQ, Slack, Teams, and any web/Electron app. Automated QA, viewport testing, visual feedback loops.

Alternatives in Testing

Spec Driven Develop — Spec-driven development workflow for AI coding agents: architecture-first planning, task decomposition, GitHub 975 ★
Mda — MDA Open Spec — a Markdown superset for agent-facing documents 615 ★
Design QA — Visual QA on an HTML/CSS implementation — checks responsive behavior at mobile/tablet/desktop, design token co 309 ★

README

\![Visitors](https://visitor-badge.laobi.icu/badge?page_id=24kchengYe.desktop-controller-skill)

Desktop Controller — AI Computer Use for Claude Code

**The open-source alternative to OpenAI Codex's computer use.** Control any Windows app — native desktop, web, and Electron — with a single AI skill. Like [OpenAI's playwright-interactive](https://github.com/openai/skills/tree/main/skills/.curated/playwright-interactive), but with **native Win32 desktop app support** that Codex can't do.

[![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)

**What GPT-5.4 does in the cloud, this skill does locally.** OpenAI's GPT-5.4 introduced "computer use" — the ability to control computers via Playwright and mouse/keyboard commands. Their `playwright-interactive` Codex skill enables visual debugging of web and Electron apps. **We go further**: our dual-engine approach adds **native Windows desktop automation** (Win32 API) alongside Playwright, letting you control apps like WeChat, DingTalk, and QQ that browser-based solutions simply can't reach.

Why This Exists

	OpenAI Codex	Claude Code + This Skill
Web/Electron apps	Playwright	Playwright
Native desktop apps	Not possible	Win32 API
Chat apps (WeChat, DingTalk, QQ)	Not possible	Full support
Visual feedback	js_repl screenshots	Screenshots + Claude Vision
QA workflow	Manual checklist	Automated QA checklist
Viewport testing	Manual	Device presets (iPhone, iPad, Pixel...)
DOM inspection	Via DevTools	Built-in inspector
Platform	Cloud only	Local (your machine)
Cost	Codex subscription	Free & open source

Demo

$ python scripts/desktop_control.py list-apps
Supported applications:
  weixin       WeChat                process=Weixin       mode=win32   search=Ctrl+F
  wxwork       WeCom (企业微信)        process=WXWork