Agent Eval Engineer — Design agent for Claude Code
Use to design and run regression evaluations for an agent, skill, tool, or prompt — happy-path, edge-case, adversarial, and historical-regression cases — and to grade results independently of whoever.
How to install Agent Eval Engineer
Installs to ~/.claude/agents/donthishivani-iva-agent-eval-engineer.md
mkdir -p ~/.claude/agents && curl -fsSL https://raw.githubusercontent.com/DonthiShivani/iva/HEAD/agents/agent-eval-engineer.md -o ~/.claude/agents/donthishivani-iva-agent-eval-engineer.md Restart Claude Code, or start a new session, for it to be picked up.
What Agent Eval Engineer does
name: agent-eval-engineer description: Use to design and run regression evaluations for an agent, skill, tool, or prompt — happy-path, edge-case, adversarial, and historical-regression cases — and to grade results independently of whoever built what's being evaluated. Use whenever a project has its own agents, tools, or prompts and needs evidence they still work before a change ships, not just a manual spot-check. tools: Read, Grep, Glob, Write, Bash maxTurns: 50
You are an independent
Alternatives in Design
- Workflow Architect Agent — Workflow design specialist who maps complete workflow trees for every system, user journey, and agent interact 669 ★
- Canvas Designer — Use this agent for UI/UX design and implementation — production-grade interfaces with intentional aesthetic 523 ★
- Asset Producer — Produces one assigned visual asset production unit for the asset stage 517 ★
Full documentation available on GitHub
View Source RepositoryRelated Agents
Wh Eval Designer
Design-phase agent, tier 2 and above only. Reviews and extends the evals.md the designer wrote: adds the edge,
Lw Story Creator
Runs the leanwheel create-story workflow for one story in an isolated context. Spawned by /story-flywheel Phas
Edge Analyst
mstack edge analyst. Finds edge cases, failure modes and logic holes in an approved design, rates them, and pr
Visual Reviewer
Reviews the finish of an HTML page against the delivery standard: accessibility, responsiveness, SEO, performa
Staff Engineer Architect
Use proactively for complex technical problems requiring deep architectural analysis, system design decisions,
UX Heuristics Expert
Usability expert running heuristic evaluations (Nielsen's 10 heuristics) on screens, flows, live sites or code
Related Skills
Ac Validation
Review Acceptance Criteria for one or more user stories against completeness and quality standards. Checks hap
Adversarial Test
Post-build adversarial review — a fresh agent stress-tests recent changes for bugs, regressions, conflicts, an
Eval Author
Draft a new eval case (eval/cases/ .json) + scaffold its golden folder, golden_pending until captured on the V