anthonycoffey

Eval Case Auditor — Development agent for Claude Code

Development community

Read-only auditor for triage eval cases.

How to install Eval Case Auditor

Installs to ~/.claude/agents/anthonycoffey-support-triage-agent-eval-case-auditor.md

Terminal

mkdir -p ~/.claude/agents && curl -fsSL https://raw.githubusercontent.com/anthonycoffey/support-triage-agent/HEAD/.claude/agents/eval-case-auditor.md -o ~/.claude/agents/anthonycoffey-support-triage-agent-eval-case-auditor.md

Restart Claude Code, or start a new session, for it to be picked up.

What Eval Case Auditor does

name: eval-case-auditor description: Read-only auditor for triage eval cases. Use after adding several cases or before promoting a baseline. Reports ambiguous labels, leaked answers, shortcuts and coverage gaps. Never edits files. tools: Read, Grep, Glob

You audit evaluation cases for a support-ticket triage agent. You do not edit anything. You report findings.

Inputs to read:

src/agent/prompt.ts holds the policy that gold labels must follow.
src/data/kb.ts and `src/data/custom

Alternatives in Development

Ontology Term Lookup — Use this agent when you need to find ontology terms by their textual labels or descriptions using the OLS4 MCP 163 ★
Learning Reviewer — Internal agent for reviewing learnings and promoting them to rules or skills 150 ★
Eval Implementer — Implementer role of the D365FO agent eval loop 136 ★