Harness Arena
Description
Blind, LMSYS-style arena for comparing AI coding agent harnesses (Claude Code, Codex CLI, OpenClaw, Hermes, OnDemand) instead of models. Same task, same model, isolated runs , humans judge blind, results roll up into an Elo leaderboard. FastAPI + MongoDB backend.
Installation
This entry records only its repository, not the path inside it, so there is no
exact command to give. Open the source below and copy the folder into
~/.claude/skills/, or the file into ~/.claude/agents/.
README
Agentic Harness Arena
[](LICENSE) [](backend/requirements.txt) [](#status) [](https://discord.gg/fhGPEaDJ5T)
**An [LMSYS Chatbot Arena](https://chat.lmsys.org/)-style blind benchmark — but for agent harnesses, not models.**
**[🔴 Try the live arena →](https://www.harness-arena.ai)**
Agentic Harness Arena runs the same task through multiple agent harnesses — Claude Code, Codex CLI, and more — holding the model constant, collects their deliverables in isolated workspaces, and lets people judge the results blind. Identities are only revealed after a score is submitted, and every verdict rolls up into a public Elo leaderboard.
If you've used Chatbot Arena to compare *models*, this is the same idea one layer up: comparing the *harness* — the CLI, tools, prompts, permissions, and execution environment wrapped around a model.
Contents
- Why Harness Arena?
- How a run works
- Supported harnesses
- Architecture
- Features
- Quick start
- Dataset format
- Configuration
- Deployment
- Add a harness
- Status
- Contributing
- License
Why Harness Arena?
The model is only one part of an agentic workflow. The harness — the CLI, tools, prompts, permissions, and execution environment — shapes the quality of the final result just as much. Two harnesses running the identical model
Related Skills
Agency Agents
A complete AI agency at your fingertips - From frontend wizards to Reddit community ninjas, from whimsy inject
AI Awesome Llm Apps
100+ AI Agents, Agent Skills and RAG Apps - Free and Open Source.
AI Firecrawl
🔥 The API to search, scrape, and interact with the web for AI
AI Artifacts Builder
Suite of tools for creating elaborate, multi-component claude.ai HTML artifacts using modern frontend web tech
AI Headroom
Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agen
AI CrewAI
Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewA
AI