LLM Eval — AI skill for Claude Code
model: claude-sonnet-4-6 domain: datascience tags: ["data-science", "machine-learning", "analytics"] source_repo: BehiSecc/awesome-claude-skills 🤖 Llm Eval LLM output evaluation harness: hallucination rate….
How to install LLM Eval
Installs to ~/.claude/skills/winnershitram-r17-behisecc-awesome-claude-skills-datascience-llm-eval/SKILL.md
mkdir -p ~/.claude/skills/winnershitram-r17-behisecc-awesome-claude-skills-datascience-llm-eval && curl -fsSL https://raw.githubusercontent.com/Winnershitram/r17-behisecc-awesome-claude-skills-datascience/HEAD/commands/llm-eval.md -o ~/.claude/skills/winnershitram-r17-behisecc-awesome-claude-skills-datascience-llm-eval/SKILL.md Restart Claude Code, or start a new session, for it to be picked up.
What LLM Eval does
model: claude-sonnet-4-6 domain: datascience tags: ["data-science", "machine-learning", "analytics"] source_repo: BehiSecc/awesome-claude-skills
🤖 Llm Eval
LLM output evaluation harness: hallucination rate, faithfulness and latency
Context
You are a senior Data Science & AI/ML specialist. The user needs help with **llm eval** in the context of data pipelines, model training, evaluation, mlops and analytical reporting.
Requirements
$ARGUMENTS
Instructions
Step 1
Alternatives in AI
- WeKnora — Open-source LLM knowledge platform: turn raw documents into a queryable RAG, an autonomous reasoning agent, an 26.9k ★
- Opencodex — Universal provider proxy for OpenAI Codex & Claude Code — use any LLM (Claude, Gemini, Grok, DeepSeek, Ollama… 12.3k ★
- Firecrawl MCP Server — 🔥 Official Firecrawl MCP Server - Adds powerful web scraping and search to Cursor, Claude and any other LLM c 6.1k ★
Full documentation available on GitHub
View Source RepositoryRelated Skills
Power Coding
Mindful-coding OS for any LLM coding agent (Claude Code, Codex, Gemini CLI) — the Five Forces: session handoff
Eval From Trace
Build an LLM-as-a-Judge eval grounded in real traces from the Progress Observability Platform.
Ground Truth Evals
An LLM eval harness graded by computed ground truth, not an LLM judge. Worked example: poker, served to models
Add Eval
Add automated eval (LLM-as-judge or deterministic) for an AI-powered feature
Process Queue
/process-queue — Batch Eval Worker (deterministik + LLM hibrit, per-agent live status)
Agent Eval Workbench
MLflow-based evaluation kit for AI agents: golden-task runner, calibrated LLM judge, list-price cost accountin
Related Agents
AI Agent Eval Writer
Use this agent when you need to write evaluation tests for AI agents using Evalite or Autoevals frameworks. Th
Askit Quality Grader
Judges whether a skill triggers and behaves correctly by running it against its eval-set and grading the outpu
LLM Evaluator
LLM evaluation specialist. Use when designing eval suites for LLM features, calibrating LLM-as-judge prompts,