Agent Eval Design — Testing skill for Claude Code
Design an evaluation for an AI agent or LLM feature: what to test, how to grade it, and how to catch regressions.
How to install Agent Eval Design
Installs to ~/.claude/skills/amey-thakur-ai-skills-agent-eval-design/SKILL.md
mkdir -p ~/.claude/skills/amey-thakur-ai-skills-agent-eval-design && curl -fsSL https://raw.githubusercontent.com/Amey-Thakur/AI-SKILLS/HEAD/commands/agent-eval-design.md -o ~/.claude/skills/amey-thakur-ai-skills-agent-eval-design/SKILL.md Restart Claude Code, or start a new session, for it to be picked up.
What Agent Eval Design does
description: "Design an evaluation for an AI agent or LLM feature: what to test, how to grade it, and how to catch regressions." argument-hint: "[system]"
You were invoked as a slash command. The user's input:
$ARGUMENTS
Use that input to fill this prompt's variables (take the main content, topic, or task from it; ask only if a required value is missing and not supplied), then follow the prompt exactly.
Design an evaluation for: {system}
Known/feared failures: {failures}
Build
Alternatives in Testing
- Claude Code Spec Workflow — Automated Kiro-style Spec workflow for Claude Code 3.6k ★
- Production Grade — Production Grade — route any build, feature, review, test, harden, ship, or docs request through the 14-agent 175 ★
- Robotics Agent Skills — Agent skills that make AI coding assistants write production-grade robotics software 170 ★
Full documentation available on GitHub
View Source RepositoryRelated Skills
Prompt Test
Test LLM prompts against sample inputs. Shows outputs, checks for regressions when prompts change, and compare
ShipGuard
Claude Code skills for automated E2E testing with agent-browser (Playwright CLI). Discover routes, generate YA
Eval Suite
Re-score tiny-spec against the SDD evaluation rubric, record it, and report the delta vs the last run.
AutoConst Spec Drawings Crosscheck Claude
Automatically catch coordination mismatches between a construction spec book and its structural drawings. Cros
AI Qe Agent
AI QE Agent with LLM Evaluation Layer — catches hallucinations, monitors chain consistency, self-heals Playwri
Pharn Regress
Detect regressions OUTSIDE the just-built feature in the USER's codebase — the fifth product-pipeline stage (s
Related Agents
AI Eval Designer
Use this agent to design a risk-tiered evaluation set for an AI feature. Trigger when the user says "design ev
Cto Self Eval
CTO-grade codebase self-evaluation. Measures code health, dead code, debt density, test meaningfulness, and ov
AI Agent Eval Writer
Use this agent when you need to write evaluation tests for AI agents using Evalite or Autoevals frameworks. Th