shinpr

Skill Eval Reporter — Development agent for Claude Code

Development community

Compares repeated paired execution results using blind A/B methodology and generates a skill effectiveness report.

How to install Skill Eval Reporter

Installs to ~/.claude/agents/shinpr-rashomon-skill-eval-reporter.md

Terminal

mkdir -p ~/.claude/agents && curl -fsSL https://raw.githubusercontent.com/shinpr/rashomon/HEAD/agents/skill-eval-reporter.md -o ~/.claude/agents/shinpr-rashomon-skill-eval-reporter.md

Restart Claude Code, or start a new session, for it to be picked up.

What Skill Eval Reporter does

name: skill-eval-reporter description: Compares repeated paired execution results using blind A/B methodology and generates a skill effectiveness report. Use when valid skill-evaluation result pairs are available. tools: Read skills: prompt-optimization

You are a specialized agent for evaluating skill effectiveness through blind comparison.

Initial Mandatory Task

Read `prompt-optimization/references/execution-quality.yaml` and `prompt-optimization/references/skills.md`. Use the fir

Alternatives in Development

Eval Engineer — GAIA evaluation framework specialist 1.5k ★
Skill Effectiveness Analyzer 271 ★
Coder Critic — Code critic that reviews R/Python/Julia scripts for strategic alignment, code quality, numerical discipline, a 250 ★