AI Qe Agent — Testing skill for Claude Code
AI QE Agent with LLM Evaluation Layer — catches hallucinations, monitors chain consistency, self-heals Playwright selectors.
How to install AI Qe Agent
This entry records only its repository, not the path inside it, so there is no
exact command to give. Open vijayarjun7/ai-qe-agent and copy the folder into
~/.claude/skills/, or the file into ~/.claude/agents/.
What AI Qe Agent does
AI QE Agent with LLM Evaluation Layer — catches hallucinations, monitors chain consistency, self-heals Playwright selectors. Claude + TruLens + LangSmith + Pinecone
Alternatives in Testing
- GAAI Framework — 95+ Drop-in governance layer (.gaai/ folder) -- backlog authorization, cross-session memory, decision tracking 113 ★
- Relentless.Analyze — Analyze consistency across spec, plan, tasks, and checklist 97 ★
- Aod.Analyze — Perform a non-destructive cross-artifact consistency and quality analysis across spec.md, plan.md, and tasks.m 89 ★
README
AI QE Agent
**End-to-End AI-Driven Quality Engineering Pipeline — Powered by Playwright + Claude AI**
        
AI QE Agent is a TypeScript automation framework that demonstrates a complete AI-driven QE pipeline: **AI writes the app → AI writes & reviews manual tests → AI generates & reviews automation scripts → Self-healing on selector/requirement changes.**
🧪 LLM Evaluation Layer
Built a custom **LLM-as-Judge eval suite** on top of the pipeline — Claude evaluating Claude's own outputs across 4 dimensions.
Eval Results (First Production Run)
| Agent | Quality | Faithfulness | Hallucination | Chain Compat |
|---|---|---|---|---|
| ManualTestGenerator | 0.87 ✅ | 0.0 ⚠️ | None | 0.0 ⚠️ |
| QAReviewAgent | 0.80 ✅ | 1.0 ✅ | None | 0.0 ⚠️ |
| AutomationScriptGenerator | 0.94 ✅ | 1.0 ✅ | Detected 🔴 | — |
| SelfHealingAgent | 1.0 ✅ | 0.0 ⚠️ | None | — |
**Avg Quality Score: 0.902 | Hallucinations caught: 2 | Pipeline breaks: 2**
Observability Stack
| Tool | Purpose |
|---|---|
| TruLens | Real-time eval dashboard (4 metrics per agent) |
| LangSmith | Production API tracing (latency, tokens, cost) |
| MLflow | Experiment tracking + run comparison |
| Pinecone | Semantic test deduplication (0.85 threshold) |
Run the eval suite
npm run eval # TypeScripRelated Skills
AI Test Platform
An AI-driven test execution platform where QA engineers save structured test cases per project and an AI agent
Agent Eval Design
Design an evaluation for an AI agent or LLM feature: what to test, how to grade it, and how to catch regressio
AI Native Sdlc Skills
Unofficial Claude Code skills adapted from Anthropic's The AI-Native SDLC playbook — the committed-artifact ch
Pixelslop
Browser-first design quality scanner. Opens real pages in Playwright, measures actual pixels, catches AI slop
Dual Gate Moa
Dual-Gate-MoA: harness-enforced dual gates for LLM agents (recon before acting, QA before shipping) + MoA mult
Ppt Skills
AI slide generator with hand-drawn style (rough.js) — text-to-PPTX pipeline with visual-first layouts, Claude
Related Agents
AI LLM Engineer
Use this agent when the user types /ai or asks for ai/llm engineer work — e.g., build a RAG pipeline over our
Review Arbiter
Authoritative LLM-as-a-Judge meta-agent that adjudicates multi-agent plan and code reviews whenever two or mor
E2e Debugger
Use this agent for Playwright E2E test debugging — test failures, selectors, timeouts, authentication flows, c
