Flaky Test Detector — Testing skill for Claude Code
Detect, analyze, and eliminate flaky tests across any test runner.
How to install Flaky Test Detector
This entry records only its repository, not the path inside it, so there is no
exact command to give. Open sametcelikbicak/flaky-test-detector and copy the folder into
~/.claude/skills/, or the file into ~/.claude/agents/.
What Flaky Test Detector does
Detect, analyze, and eliminate flaky tests across any test runner. An AI agent skill that identifies non-deterministic test failures, categorizes root causes, and applies targeted fixes.
Alternatives in Testing
- Test Runner — Run Python tests with pytest, unittest, or other testing frameworks 23.4k ★
- Skill Debug — Debug issues methodically — use when stuck on errors, test failures, or unexpected behavior 2.8k ★
- Flaky Fix — 不安定なテスト(flaky test)の原因を分析し、テストの安定化を試みます 974 ★
README
Flaky Test Detector
[](https://awesome.re) [](https://github.com/sametcelikbicak/flaky-test-detector)
Detect, analyze, and eliminate flaky tests across any test runner. An AI agent skill that identifies non-deterministic test failures, categorizes root causes, and applies targeted fixes.
Compatible with **opencode**, **Claude Code**, **Cursor**, **Windsurf**, and **GitHub Copilot**.
What it does
- Detects your test runner (Vitest, Jest, Playwright, Cypress, Mocha, AVA)
- Harvests flaky candidates by running tests multiple times
- Analyzes root causes across 5 categories:
- Async timing issues
- Shared mutable state
- Test isolation gaps
- Environment sensitivity
- Race conditions
- Applies category-specific fixes with proven strategies
- Verifies fixes by re-running the detection loop
- Generates a flaky test report
Install
# rolecraft — install from GitHub (recommended)
npx rolecraft install sametcelikbicak/flaky-test-detector
# or via agentskill.sh
/learn @sametcelikbicak/flaky-test-detector
# or copy manually
cp -r flaky-test-detector .opencode/skills/
Supported runners
- Vitest
- Jest
- Playwright
- Cypress
- Mocha
- AVA
- react-scripts (CRA)
License
MIT
Related Skills
Parallel Fix
Use when facing 3+ independent test failures or broken subsystems with different root causes. Dispatches one a
Skill CI Churn
GitHub Actions cost analyzer & flaky-test detector for pull requests. Measures wasted CI compute, classifies c
Flaky Test
Diagnose a flaky test by running it N times. Delegates to flaky-test-isolator subagent — N runs, signature-gro
Canary Debug Flake
Diagnose a flaky test and propose a deterministic fix from code, CI logs, or a failure description.
Cleanup Summary
This document lists all the files that were removed during the cleanup process to eliminate test data, test fi
Fix And Validate
Run the Lancet2 fix-mode validation suite (iwyu-fix + lint-check + test). Mirrors the pre-commit gate's scope
Related Agents
Dnp Build Error Resolver
🔧 Autonomous iterative build-error fixing — parses dotnet build/test output, diagnoses root causes, and appli
Flake Detector
Use when a test is suspected to be non-deterministic — passes sometimes, fails sometimes, or fails only in CI.
QA Fixer
Bounded test-fix loop agent for beast. Diagnoses test failures and applies targeted fixes, max 5 cycles.