Ai Eval Designer banner
kumaran-is kumaran-is

Ai Eval Designer

Testing & QA community

Description

--- name: ai-eval-designer description: Use this agent to design a risk-tiered evaluation set for an AI feature. Trigger when the user says "design evals for", "I need an eval set", "what should I test for this AI feature", "build a golden dataset", or before launching an AI feature that doesn't have evals yet. Also trigger after an incident, to add the new failure mode as eval cases. tools: Read, Grep, Glob, Write model: opus last-reviewed: 2026-05-17 skills: - ai-playbook --- # AI Eval Desi

Installation

Installs to ~/.claude/agents/kumaran-is-claude-code-onboarding-ai-eval-designer.md

Terminal
mkdir -p ~/.claude/agents && curl -fsSL https://raw.githubusercontent.com/kumaran-is/claude-code-onboarding/HEAD/.claude/agents/ai-eval-designer.md -o ~/.claude/agents/kumaran-is-claude-code-onboarding-ai-eval-designer.md

Restart Claude Code, or start a new session, for it to be picked up.

Full documentation available on GitHub

View Source Repository