Evaluation Orchestrator — Development agent for Claude Code
Use for coordinating evaluation experiments, managing experiment execution, and overseeing evaluation workflows.
How to install Evaluation Orchestrator
Installs to ~/.claude/agents/homericintelligence-scylla-evaluation-orchestrator.md
mkdir -p ~/.claude/agents && curl -fsSL https://raw.githubusercontent.com/HomericIntelligence/Scylla/HEAD/.claude/agents/evaluation-orchestrator.md -o ~/.claude/agents/homericintelligence-scylla-evaluation-orchestrator.md Restart Claude Code, or start a new session, for it to be picked up.
What Evaluation Orchestrator does
name: evaluation-orchestrator description: Use for coordinating evaluation experiments, managing experiment execution, and overseeing evaluation workflows. Invoked for running tier comparisons and evaluation studies. tools: Read,Write,Edit,Bash,Grep,Glob,Task model: sonnet
Evaluation Orchestrator Agent
Role
Level 1 Domain Orchestrator responsible for coordinating evaluation experiments. Manages the execution of tier comparisons, oversees data collection, and ensures experiment in
Alternatives in Development
- Eval Engineer — GAIA evaluation framework specialist 1.5k ★
- Fable Orchestrator — Staged-execution orchestrator for large, multi-part, or multi-session tasks 837 ★
- Code Agent — Experiment implementation, execution, and monitoring 728 ★
Full documentation available on GitHub
View Source RepositoryRelated Agents
Autoresearch Orchestrator
Use this agent to run an autoresearch experiment session end-to-end — setup, baseline, and a batch of edit→mea
Loop Orchestrator
Route reflex-loop execution to the next role based on run state, stop guards, and last evaluation. Use proacti
Noemeo Researcher
Plans, runs and writes up studies in Noemeo repos -- falsifiable questions, prior-work checks, public benchmar
Baime Iteration Executor
Executes a single experiment iteration through its lifecycle phases. This involves coordinating Meta-Agent cap
Biz Release Manager
Release manager who coordinates deployments, manages release schedules, and oversees go-live processes. Use th
Experiment
Performs focused technical experiments for uncertain behavior, algorithms, geometry, rendering, or performance
Related Skills
Experiment Design
Design empirical studies through power analysis, pre-analysis planning,
Clone Study
A Claude Code skill that studies and recreates high-end websites (Awwwards-tier) from a URL — capture, analyze
Claude Hook Experiment
Reproducible Claude Code hook experiments for validating settings-based hook behavior
