App Eval — Development skill for Claude Code
/app-eval — run deterministic agent evaluations.
How to install App Eval
Installs to ~/.claude/skills/vmobifystudio-app-dev-team-app-eval/SKILL.md
mkdir -p ~/.claude/skills/vmobifystudio-app-dev-team-app-eval && curl -fsSL https://raw.githubusercontent.com/vmobifystudio/app-dev-team/HEAD/commands/app-eval.md -o ~/.claude/skills/vmobifystudio-app-dev-team-app-eval/SKILL.md Restart Claude Code, or start a new session, for it to be picked up.
What App Eval does
/app-eval — run deterministic agent evaluations
Evaluation manifests define reproducible cases with an executable command, expected exit code, and required evidence text:
node "${CLAUDE_PLUGIN_ROOT}/scripts/eval-lab.mjs" --manifest eval/manifest.json
Add role, policy, workflow, and long-horizon fixtures as the team grows. A missing manifest or malformed case is `CANNOT EVALUATE`, never a passing empty suite.
Alternatives in Development
- Learn Eval — 从会话中提取可复用的模式(Patterns),在保存前进行质量自评,并确定合适的保存位置(全局 vs 项目) 1.9k ★
- /autopilot — Autonomous hunt loop with deterministic scope safety and configurable checkpoints 1.2k ★
- Hippo Feature — Build one hippo feature from RESEARCH.md using the micro-eval TDD loop 734 ★
Full documentation available on GitHub
View Source RepositoryRelated Skills
Pharn Dev Eval
Run a capability's eval LIVE via claude -p N times into isolated runs/, then COUNT structural pass/fail across
Skill Evaluations Bottom 10
Bottom 10 Skills: Skill-Judge Evaluations with TDD Improvements
Instruction Budget
A public repo of an evaluations research project
Harbor
Harbor is a framework for running agent evaluations and creating and using RL environments.
Puppetmaster
Provider-neutral control plane for durable-state agent swarms: subprocess workers, leases, artifacts, memory,
Nopus
Deterministic prose checks for clearer coding-agent responses
Related Agents
Agent Eval Engineer
Use to design and run regression evaluations for an agent, skill, tool, or prompt — happy-path, edge-case, adv
Omd A11y Auditor
Stage 0 deterministic gate of the eval pipeline. Validates DESIGN.md Core v2 binding and portability, then run
QA Mobile
Mobile QA executor for the Auxi React Native app. Runs deterministic Maestro flows on the local iOS simulator