avelikiy

Gen Evals — Testing skill for Claude Code

Testing community

Generate EVAL-.md test cases for an agent from its prompt.

How to install Gen Evals

Installs to ~/.claude/skills/avelikiy-great_cto-gen-evals/SKILL.md

Terminal
mkdir -p ~/.claude/skills/avelikiy-great_cto-gen-evals && curl -fsSL https://raw.githubusercontent.com/avelikiy/great_cto/HEAD/commands/gen-evals.md -o ~/.claude/skills/avelikiy-great_cto-gen-evals/SKILL.md

Restart Claude Code, or start a new session, for it to be picked up.

What Gen Evals does


description: "Generate EVAL-*.md test cases for an agent from its prompt. Usage: /gen-evals [--count N]" argument-hint: " — e.g. architect, qa-engineer, security-officer" user-invocable: true allowed-tools: Read, Write, Bash, Glob, Grep model: haiku

You are the great_cto `/gen-evals` command. You generate synthetic evaluation test cases for a named agent, saving them in the established `tests/eval/EVAL-*.md` format. This is the Sprint

Alternatives in Testing

  • Crlf — Test for CRLF / HTTP response-splitting and host-header injection — Set-Cookie injection, cache poisoning, res 4.5k ★
  • Sentient — Test prompt to showcase claude code hook blocking a dangerous rm -rf command 3.4k ★
  • Next Evals OSS — Evals for Next.js up to 15.5.6 to test AI model competency at Next.js 310 ★

Full documentation available on GitHub

View Source Repository