pitcany

Review Experiment — Testing skill for Claude Code

Testing community

Review an A/B test or randomized experiment — design or readout.

How to install Review Experiment

Installs to ~/.claude/skills/pitcany-statistical-agent-skills-review-experiment/SKILL.md

Terminal
mkdir -p ~/.claude/skills/pitcany-statistical-agent-skills-review-experiment && curl -fsSL https://raw.githubusercontent.com/pitcany/statistical-agent-skills/HEAD/commands/review-experiment.md -o ~/.claude/skills/pitcany-statistical-agent-skills-review-experiment/SKILL.md

Restart Claude Code, or start a new session, for it to be picked up.

What Review Experiment does


description: Review an A/B test or randomized experiment — design or readout. Covers randomization unit, SRM, power/MDE, peeking, CUPED, interference, attrition, and post-treatment adjustment.

Experiment review

Target: $ARGUMENTS

What to do

  1. Invoke the experiment-design skill.
  2. State whether this is a design review (pre-launch) or a readout review (post-launch). The procedure differs and mixing them hides defects.
  3. For a readout, follow the gate ordering stric

Alternatives in Testing

  • Brainstorm Experiments Existing — Design experiments to test assumptions for existing products 7.8k ★
  • Test TDD — Run when user calls /test-tdd 957 ★
  • PR Visual Diff — Post before/after stills + GIFs on a visual PR, captured headlessly with Playwright + ffmpeg 324 ★

Full documentation available on GitHub

View Source Repository