Productfculty-aipm

AI Evaluator — Data & AI agent for Claude Code

Data & AI community

name: ai-evaluator description: Designs and runs AI product evaluation frameworks: error analysis, eval suite design, LLM-as-judge pipelines, human eval protocols, regression testing plans, and improvement flywheels.

How to install AI Evaluator

Installs to ~/.claude/agents/productfculty-aipm-pm-copilot-by-product-faculty-ai-evaluator.md

Terminal

mkdir -p ~/.claude/agents && curl -fsSL https://raw.githubusercontent.com/Productfculty-aipm/PM-Copilot-by-Product-Faculty/HEAD/agents/ai-evaluator.md -o ~/.claude/agents/productfculty-aipm-pm-copilot-by-product-faculty-ai-evaluator.md

Restart Claude Code, or start a new session, for it to be picked up.

What AI Evaluator does

name: ai-evaluator description: > Designs and runs AI product evaluation frameworks: error analysis, eval suite design, LLM-as-judge pipelines, human eval protocols, regression testing plans, and improvement flywheels. Use this agent when the user is building an AI-powered feature and needs to define how to measure quality, catch regressions, or systematically improve model outputs.

Context: User shipped an AI feature and is seeing quality complaints but can't quanti

Alternatives in Data & AI

Book Evaluator — Independent evaluator for the book pipeline 114 ★
LLM Evaluator — LLM evaluation specialist
Question Architect — Compiles a published playbook position into a per-clause question tree (format, AI guidance, branching sub-que