AI Evaluation Engineer — Data & AI agent for Claude Code
Measure AI quality honestly with datasets, metrics, and judges that survive scrutiny.
How to install AI Evaluation Engineer
Installs to ~/.claude/agents/bakhod1r-awesome-agents-ai-evaluation-engineer.md
mkdir -p ~/.claude/agents && curl -fsSL https://raw.githubusercontent.com/bakhod1r/awesome-agents/HEAD/.claude/agents/ai-evaluation-engineer.md -o ~/.claude/agents/bakhod1r-awesome-agents-ai-evaluation-engineer.md Restart Claude Code, or start a new session, for it to be picked up.
What AI Evaluation Engineer does
name: ai-evaluation-engineer description: Measure AI quality honestly with datasets, metrics, and judges that survive scrutiny. Invoke for data-ai-team work. model: opus tools: Read, Write, Edit, Grep, Glob, Bash, WebSearch, WebFetch
AI Evaluation Engineer
**Team:** Data & AI Engineering Team
Role
AI Evaluation Engineer, Data & AI Engineering Team.
Mission
Measure AI quality honestly with datasets, metrics, and judges that survive scrutiny.
Primary Objective
Within the
Alternatives in Data & AI
- Solid Skills — AI agent skill for writing senior-engineer quality code through SOLID principles, TDD, and clean architecture 356 ★
- Pace Analyst — Analyst perspective agent for devpace 57 ★
- Data Governance — Comprehensive agent for managing Datadog data governance including access control (datasets, IP/domain allowli 42 ★
Full documentation available on GitHub
View Source RepositoryRelated Agents
Backup Disaster Recovery Engineer
Guarantee the organisation can come back from data loss, ransomware, or site failure. Invoke for itops-team wo
ML Engineer
Use for ML/AI model work — training, fine-tuning, evaluation, RAG, agents, embeddings, evals, deployment, MLOp
Askit Quality Grader
Judges whether a skill triggers and behaves correctly by running it against its eval-set and grading the outpu
Data Lead
L0.9 Data team lead — owns the measurement strategy for a product: which metrics matter, how they're defined,
Ecc RAG Pipeline Reviewer
Reviews RAG (Retrieval-Augmented Generation) pipelines for retrieval quality, chunking strategy, embedding cho
Sf ML Engineer
ML/DL Engineer of the Software Factory cell. Use for machine learning and deep learning work - data contracts,
Related Skills
Head To Head
Head-to-head — measure ripwire against a baseline, honestly
Open Sdlc Skills
A software team as Claude Code agent skills — PM, Architect, Project Manager, Sprint Master, Engineer, QA, Rev
Coverage Gaps
Find production behaviors that have no evaluation measuring them, and prioritize which judges to build.
