App Eval — Development skill for Claude Code
/app-eval — run deterministic agent evaluations.
How to install App Eval
Installs to ~/.claude/skills/vmobifystudio-app-dev-team-app-eval/SKILL.md
mkdir -p ~/.claude/skills/vmobifystudio-app-dev-team-app-eval && curl -fsSL https://raw.githubusercontent.com/vmobifystudio/app-dev-team/HEAD/commands/app-eval.md -o ~/.claude/skills/vmobifystudio-app-dev-team-app-eval/SKILL.md Restart Claude Code, or start a new session, for it to be picked up.
What App Eval does
/app-eval — run deterministic agent evaluations
Evaluation manifests define reproducible cases with an executable command, expected exit code, and required evidence text:
node "${CLAUDE_PLUGIN_ROOT}/scripts/eval-lab.mjs" --manifest eval/manifest.json
Add role, policy, workflow, and long-horizon fixtures as the team grows. A missing manifest or malformed case is `CANNOT EVALUATE`, never a passing empty suite.
Alternatives in Development
- Learn Eval — 从会话中提取可复用的模式(Patterns),在保存前进行质量自评,并确定合适的保存位置(全局 vs 项目) 1.9k ★
- /autopilot — Autonomous hunt loop with deterministic scope safety and configurable checkpoints 1.2k ★
- Hippo Feature — Build one hippo feature from RESEARCH.md using the micro-eval TDD loop 734 ★
Full documentation available on GitHub
View Source RepositoryRelated Skills
Pharn Dev Eval
Run a capability's eval LIVE via claude -p N times into isolated runs/, then COUNT structural pass/fail across
Agent Skill Installer
A simple desktop app for deterministic agent skill installation.
Skill Evaluations Bottom 10
Bottom 10 Skills: Skill-Judge Evaluations with TDD Improvements
Instruction Budget
A public repo of an evaluations research project
Harbor
Harbor is a framework for running agent evaluations and creating and using RL environments.
Route Eval
/route-eval — Evaluate a project and set its routing profile
Related Agents
Agent Eval Engineer
Use to design and run regression evaluations for an agent, skill, tool, or prompt — happy-path, edge-case, adv
Omd A11y Auditor
Stage 0 deterministic gate of the eval pipeline. Validates DESIGN.md Core v2 binding and portability, then run
Story QA
Verify-phase crew member that runs a story's eval set against the DEV story through ./scripts/storyline eval-r