Askit Quality Grader — Data & AI agent for Claude Code
Judges whether a skill triggers and behaves correctly by running it against its eval-set and grading the outputs.
How to install Askit Quality Grader
Installs to ~/.claude/agents/product-on-purpose-agent-skills-toolkit-askit-quality-grader.md
mkdir -p ~/.claude/agents && curl -fsSL https://raw.githubusercontent.com/product-on-purpose/agent-skills-toolkit/HEAD/agents/askit-quality-grader.md -o ~/.claude/agents/product-on-purpose-agent-skills-toolkit-askit-quality-grader.md Restart Claude Code, or start a new session, for it to be picked up.
What Askit Quality Grader does
name: askit-quality-grader description: Judges whether a skill triggers and behaves correctly by running it against its eval-set and grading the outputs. Use when delegating a behavioral evaluation - the opt-in LLM-judge role behind askit-evaluate's behavioral mode, distinct from the deterministic conformance core. tools:
- Read
- Bash
metadata:
version: 0.1.1
tier: convergent
status: active
agent-targets:
- claude
askit-quality-grader
Role
The behavioral-judge del
Alternatives in Data & AI
- Docs Drift Reviewer — Checks whether clickhouse-go documentation matches changes to its ClickHouse API, database/sql API, transports 3.3k ★
- PostgreSQL Pglite Pro — Role: Senior PostgreSQL and PgLite Engineer specializing in robust database architecture, perfor 1.5k ★
- Patina Detector — Triggers when Claude needs to find AI-writing patterns or suspect zones in KO/EN/ZH/JA text 352 ★
Full documentation available on GitHub
View Source RepositoryRelated Agents
AI Coach Grader
Independent, strict grader for the student's AI Engineer course in ~/ai-engineer-course. Use only when the /ai
Wikiskill Grader
Strict LLM-judge grader — given a task's success criteria and an inference agent's transcript/final answer, re
Impl Agent UX
Reviews implementation plans from the perspective of AI agent system design. Use when evaluating whether the i
Triage TS
LLM instruction for the TypeScript orchestrator triage role. Receives a task description, project structure sn
Entity Adjudicator
Decides whether candidate entity/person pairs refer to the same real-world thing, using only the evidence quot
LLM Evaluator
LLM evaluation specialist. Use when designing eval suites for LLM features, calibrating LLM-as-judge prompts,
Related Skills
Opencode Plugin Comment Judge
opencode plugin: a model judges every comment your agent writes and removes or rewrites the ones that do not e
Trigger Doctor
🩺 Behavioral testing for skill triggers — diagnose why a skill never fires (or fires too often), prescribe a
UX Fix
Opt-in fix loop. Reads the latest report from .ux/, validates working tree, and applies findings as atomic com