Claude Code Test Runner — Testing skill for Claude Code
An automated E2E natural language test runner built on Claude Code.
How to install Claude Code Test Runner
This entry records only its repository, not the path inside it, so there is no
exact command to give. Open firstloophq/claude-code-test-runner and copy the folder into
~/.claude/skills/, or the file into ~/.claude/agents/.
What Claude Code Test Runner does
This project enables full E2E test automation using Claude Code.
Alternatives in Testing
- Test Runner — Run Python tests with pytest, unittest, or other testing frameworks 23.4k ★
- OpenAgentsControl — AI agent framework for plan-first development workflows with approval-based execution 4.8k ★
- Claude Code Spec Workflow — Automated Kiro-style Spec workflow for Claude Code 3.6k ★
README
Claude Code Test Runner
This project enables full E2E test automation using Claude Code.
Tests are defined using simple natural language steps. Claude Code performs these steps sequentially in a browser through the Playwright MCP, making decisions about element selection, timing, and validation based on the test descriptions.
Why Claude Code as a test runner?
Professional software engineers have been successfully writing automated tests for decades. With the introduction of tools like Claude Code, traditional tests can be written even faster. Why would anyone use Claude Code as a test runner?
First, this test runner was not made to replace traditional unit, integration, or manual testing strategies. It is meant to bolster confidence in the final end-to-end experience of your web application. Ideally, the Claude Code Test Runner sits somewhere between traditional automated E2E tests and manual E2E sanity tests.
Claude Code can execute tests like a real human
Imagine performing manual E2E tests with human-like intuition dozens or hundreds of times each day. That's what Claude Code Test Runner can deliver.
- Natural language test definitions: Tests describe what to test rather than how to test it
- Visual understanding: Can validate UI states based on visual appearance
- Highly scalable: Run as many tests as you are willing to pay for (requires Claude Code subscriptions or incurs API costs).
Claude Code can roll with the punches
E2E tests typically tie together a large number of discrete systems. A lot can happen in the span of a single test, and it is difficult to write traditional E2E tests that account for every edge case.
Claude Code is highly adaptive. It is not tripped up by network blips, minor UX updates, or other innocuous changes and hiccups. It's the perfect test runner for environments where a lot can go wrong.
- Adaptive element selection: Finds elements based on context rather than fixed selectors
...
Related Skills
Canary Write Test
Generate production-ready test code from a natural-language requirement (Playwright, Vitest, Pytest, k6).
Maestro Spec
Intent-driven spec precipitation — state a constraint in natural language (加一条规范:禁止用 any / 记录架构约束:服务间走 gRPC /
Skillopt QA
Minimal faithful re-implementation of Microsoft SkillOpt: a text-space optimizer that trains a deployable natu
Nativeapptemplate Agent
Turn a natural-language spec into a coherent three-platform SaaS — Rails 8.1 API + native SwiftUI iOS + native
P4p Demo
cc-p4p — Claude Code for Product Managers. PM-grade orchestration: research, spec, roadmap, communicate, metri
ShipGuard
Claude Code skills for automated E2E testing with agent-browser (Playwright CLI). Discover routes, generate YA
Related Agents
API Test Generator
Use this agent to generate Playwright API tests using the request fixture. Converts natural language API specs
QA Automation Engineer
Use this agent for establishing testing infrastructure, developing automated test strategies, and ensuring cod
Test Automation Engineer
Executes targeted or comprehensive automated tests (Jest backend, Playwright frontend, E2E, visual regression)