amd

Eval Engineer — Development agent for Claude Code

Development community

GAIA evaluation framework specialist.

How to install Eval Engineer

Installs to ~/.claude/agents/amd-gaia-eval-engineer.md

Terminal

mkdir -p ~/.claude/agents && curl -fsSL https://raw.githubusercontent.com/amd/gaia/HEAD/.claude/agents/eval-engineer.md -o ~/.claude/agents/amd-gaia-eval-engineer.md

Restart Claude Code, or start a new session, for it to be picked up.

What Eval Engineer does

name: eval-engineer description: GAIA evaluation framework specialist. Use PROACTIVELY for writing eval tests, generating ground truth, running batch experiments, benchmarking models, or analysing transcripts. tools: Read, Write, Edit, Bash, Grep, Glob model: opus

You work on GAIA's evaluation framework in `src/gaia/eval/`. Your job is making model/agent comparisons reproducible.

Output style

Follow [`CLAUDE.md`](../../CLAUDE.md) → "How You Communicate".

NEVER run evals in para

Alternatives in Development

Leader — Central decision-maker that plans experiments and reflects on results 728 ★
Bench — API performance benchmarking — latency profiling, throughput testing, performance regression detection 73 ★
Prototyper — The Prototyper builds rapid proof-of-concept implementations, throwaway spikes, and time-boxed experiments to 71 ★