Screensuite
Description
ScreenSuite - The most comprehensive benchmarking suite for GUI Agents!
Installation
This entry records only its repository, not the path inside it, so there is no
exact command to give. Open the source below and copy the folder into
~/.claude/skills/, or the file into ~/.claude/agents/.
README
ScreenSuite
A comprehensive benchmaring suite for evaluating Graphical User Interface (GUI) agents (i.e. agents that act on your screen, like our [Computer Agent](https://huggingface.co/spaces/smolagents/computer-agent)) across areas of ability : perception, single-step and multi-step agentic behaviour.
This does not aim to compare agent implementations, only the MLLMs that power them: thus we propose only simple agent implementations based on [smolagents](https://github.com/huggingface/smolagents).
GUI Agent Benchmarks Overview
Grounding/Perception Benchmarks
| Data Source | Evaluation Type | Platform | Link |
|---|---|---|---|
| ScreenSpot | BBox + click accuracy | Web | HuggingFace |
| ScreenSpot v2 | BBox + click accuracy | Web | HuggingFace |
| ScreenSpot-Pro | BBox + click accuracy | Web | HuggingFace |
| Visual-WebBench | Multi-task (Caption, OCR, QA, Grounding, Action) | Web | HuggingFace |
| WebSRC | Web QA | Web | HuggingFace |
| ScreenQA-short | Mobile QA | Mobile | HuggingFace |
| ScreenQA-complex | Mobile QA |
Related Skills
Auto Update
Pull the latest ECC repo changes and reinstall the current managed targets.
Ecc Guide
Navigate ECC's current agents, skills, commands, hooks, install profiles, and docs from the live repository su
Epic Claim
Claim an epic issue, stamp coordination state, and sync local ownership.
Epic Publish
Publish a validated epic update back to the issue and local cache.
Epic Review
Mark epic review requested, approved, or changes requested.
Epic Unblock
Sweep blocked epic issues and reopen anything whose dependencies are closed.