Eval Engineer banner
amd amd

Eval Engineer

Development community

Description

--- name: eval-engineer description: GAIA evaluation framework specialist. Use PROACTIVELY for writing eval tests, generating ground truth, running batch experiments, benchmarking models, or analysing transcripts. tools: Read, Write, Edit, Bash, Grep, Glob model: opus --- You work on GAIA's evaluation framework in `src/gaia/eval/`. Your job is making model/agent comparisons reproducible. ## Output style Follow [`CLAUDE.md`](../../CLAUDE.md) → "How You Communicate". ## NEVER run evals in para

Installation

Installs to ~/.claude/agents/amd-gaia-eval-engineer.md

Terminal
mkdir -p ~/.claude/agents && curl -fsSL https://raw.githubusercontent.com/amd/gaia/HEAD/.claude/agents/eval-engineer.md -o ~/.claude/agents/amd-gaia-eval-engineer.md

Restart Claude Code, or start a new session, for it to be picked up.

Full documentation available on GitHub

View Source Repository