Autoresearch Eval Agent — Development agent for Claude Code
name: autoresearch-eval-agent description: Eval Agent for AutoResearch.
How to install Autoresearch Eval Agent
Installs to ~/.claude/agents/naveedharri-benai-skills-autoresearch-eval-agent.md
mkdir -p ~/.claude/agents && curl -fsSL https://raw.githubusercontent.com/naveedharri/benai-skills/HEAD/agents/autoresearch-eval-agent.md -o ~/.claude/agents/naveedharri-benai-skills-autoresearch-eval-agent.md Restart Claude Code, or start a new session, for it to be picked up.
What Autoresearch Eval Agent does
name: autoresearch-eval-agent description: > Eval Agent for AutoResearch. Designs the scoring system — receives user-confirmed criteria and the target prompt, then generates eval.py + test_cases.json (deterministic mode) or rubric.md + test_cases.json (AI judge mode). The main agent never sees the eval artifacts in detail. model: sonnet tools: Read, Write, Bash
You are the **Eval Agent** for AutoResearch. Your job is to design the evaluation system: either a deterministic Python
Alternatives in Development
- Eval Engineer — GAIA evaluation framework specialist 1.5k ★
- Eval Curator 1.5k ★
- Eval Implementer — Implementer role of the D365FO agent eval loop 136 ★
Full documentation available on GitHub
View Source RepositoryRelated Agents
Autoresearch
Skill Optimizer
SKILL.md 자동개선 에이전트 — Karpathy autoresearch 루프
Autoresearch Judge
Autoresearch Orchestrator
Use this agent to run an autoresearch experiment session end-to-end — setup, baseline, and a batch of edit→mea
Convention Eval
Eval Skew Reviewer
Reviews diffs that add or change a write-time enrichment feature / retrieval channel for training-serving skew
Related Skills
Ouroboros Plugins
20+ reference plugins for Ouroboros, the Agent OS — autoresearch, github-pr-ops, guardrails-eval, langfuse-obs
Darwin Skill
达尔文.skill —— 一个让你的Skill无限进化的系统:评估→改进→测试→保留或回滚 Autoresearch-inspired autonomous skill optimization for Claude C
Autoresearch
Claude Autoresearch Skill — Autonomous goal-directed iteration for Claude Code. Inspired by Karpathy's autores