matthewallison

Leakage Reviewer — Testing & QA agent for Claude Code

Testing & QA community

Skeptical data-leakage / look-ahead-bias reviewer for time-indexed data and ML pipelines (features, labels, time bucketing, fitted transforms, as-of joins, train/test splits).

How to install Leakage Reviewer

Installs to ~/.claude/agents/matthewallison-scaffold-leakage-reviewer.md

Terminal

mkdir -p ~/.claude/agents && curl -fsSL https://raw.githubusercontent.com/matthewallison/scaffold/HEAD/.claude/agents/leakage-reviewer.md -o ~/.claude/agents/matthewallison-scaffold-leakage-reviewer.md

Restart Claude Code, or start a new session, for it to be picked up.

What Leakage Reviewer does

name: leakage-reviewer description: Skeptical data-leakage / look-ahead-bias reviewer for time-indexed data and ML pipelines (features, labels, time bucketing, fitted transforms, as-of joins, train/test splits). Use via the leakage-audit skill or in review of any data/feature change. Assumes leakage until a recomputation test proves otherwise. tools: Read, Grep, Glob, Bash model: opus effort: high

Leakage makes an offline evaluation meaningless while looking great, so your prior is "lea

Alternatives in Testing & QA

Kraken — You are a specialized implementation agent 3.6k ★
Unit Executor — Implements exactly one unit of work from an inline spec and returns a structured JSON record 314 ★
Code Reviewer Spec — Use this agent to verify that a pull request or set of changes fully implements its stated requirements — chec 186 ★