nilltadios

Cosmic Computer Use — Development skill for Claude Code

Development community

Claude Code skill for COSMIC (cosmic-comp) Wayland: mouse/keyboard via the RemoteDesktop portal's EIS socket, windows and dialog-free screenshots/recording via Wayland protocols, controls by name (AT.

How to install Cosmic Computer Use

This entry records only its repository, not the path inside it, so there is no exact command to give. Open nilltadios/cosmic-computer-use and copy the folder into ~/.claude/skills/, or the file into ~/.claude/agents/.

What Cosmic Computer Use does

Claude Code skill for COSMIC (cosmic-comp) Wayland: mouse/keyboard via the RemoteDesktop portal's EIS socket, windows and dialog-free screenshots/recording via Wayland protocols, controls by name (AT-SPI) and OCR

Alternatives in Development

  • Add Portal — /add-portal - Generate a Job-Portal Search Skill for Your Local Market 36.6k ★
  • Peon Ping — Warcraft III Peon voice notifications (+ StarCraft, Portal, Zelda) for Claude Code and other agents 4k ★
  • New Portal — Renamed → /portaljs-new-portal 2.3k ★

README

cosmic-computer-use

A [Claude Code](https://claude.com/claude-code) skill for controlling a **COSMIC** desktop (System76's cosmic-comp, Wayland): mouse and keyboard, window control, screenshots, screen recording, and finding UI controls by name (accessibility) or by text (OCR). No root, no `ydotool`/uinput, no pip packages, nothing to compile, and one permission dialog ever. It is the COSMIC counterpart of [kde-computer-use](https://github.com/nilltadios/kde-computer-use) and [gnome-computer-use](https://github.com/nilltadios/gnome-computer-use), with the same commands.

Script Does How
scripts/cosmic-input.py move, click (left/right/middle, double), drag, scroll, key combos, typing, Shift/Ctrl-click RemoteDesktop portal (restore token) → ConnectToEIS → libei via ctypes
scripts/cosmic-window.py list, activate, minimize, maximize, fullscreen, sticky, move to a monitor, close, wait-stable, launch, workspaces ext-foreign-toplevel-list, zcosmic-toplevel-info, zcosmic-toplevel-manager
scripts/cosmic-capture.py screenshots of the desktop, a monitor, an area or a window; recordings of the same ext-image-copy-capture → PNG (GdkPixbuf) or ffmpeg
scripts/cosmic-a11y.py list controls, find them by name, press them without the mouse AT-SPI via PyGObject (gi.repository.Atspi)
scripts/cosmic-ocr.py find text on screen and where it is tesseract
scripts/cosmic-learn.py add, list and check lessons in LEARNINGS.md plain Python
scripts/ccu_wayland.py a small pure-Python Wayland client driven by protocols/*.xml stdlib sockets + SCM_RIGHTS

`SKILL.md` is what Claude reads: when to use which tool, safety rules, and every command. `LEARNINGS.md` holds verified lessons agents record while using the skill; `LEARNINGS.local.md` (`cosmic-learn.py add --local`) is git-ignored, for this machine only.

How it gets access on COSMIC

  • Windows and pixels come straight from Wayland