redhat-community-ai-tools

Prompt Test — Testing skill for Claude Code

Testing community

Test LLM prompts against sample inputs.

How to install Prompt Test

Installs to ~/.claude/commands/redhat-community-ai-tools-claude-code-setup-evaluator-prompt-test.md

Terminal

mkdir -p ~/.claude/commands && curl -fsSL https://raw.githubusercontent.com/redhat-community-ai-tools/claude-code-setup-evaluator/HEAD/.claude/commands/prompt-test.md -o ~/.claude/commands/redhat-community-ai-tools-claude-code-setup-evaluator-prompt-test.md

Restart Claude Code, or start a new session, for it to be picked up.

What Prompt Test does

description: "Test LLM prompts against sample inputs. Shows outputs, checks for regressions when prompts change, and compares different prompt versions side-by-side."

Prompt Test

Test your LLM prompts before deploying them. Run a prompt against sample inputs, inspect the outputs, and catch regressions when you modify prompts.

When to Use

After editing a prompt template (e.g., prompts/person_prompts.py)
Before committing prompt changes to make sure outputs didn't degrade

Alternatives in Testing

#29 — #52, #103) 92.5k ★
Pua — Use when the user invokes /pua or asks for PUA mode, try-harder/retry help, change-approach coaching, completi 19.5k ★
Marketing Skills Versions — Current versions of all skills 13.8k ★