Harness Arena banner
Ondemand-OSS Ondemand-OSS

Harness Arena

AI community

Description

Blind, LMSYS-style arena for comparing AI coding agent harnesses (Claude Code, Codex CLI, OpenClaw, Hermes, OnDemand) instead of models. Same task, same model, isolated runs , humans judge blind, results roll up into an Elo leaderboard. FastAPI + MongoDB backend.

Installation

This entry records only its repository, not the path inside it, so there is no exact command to give. Open the source below and copy the folder into ~/.claude/skills/, or the file into ~/.claude/agents/.

README

Agentic Harness Arena

[![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](LICENSE) [![Python 3.10+](https://img.shields.io/badge/python-3.10+-blue.svg)](backend/requirements.txt) [![Status: early / v0](https://img.shields.io/badge/status-early%20%2F%20v0-orange.svg)](#status) [![Discord](https://img.shields.io/badge/Discord-Join-5865F2?logo=discord&logoColor=white)](https://discord.gg/fhGPEaDJ5T)

**An [LMSYS Chatbot Arena](https://chat.lmsys.org/)-style blind benchmark — but for agent harnesses, not models.**

**[🔴 Try the live arena →](https://www.harness-arena.ai)**

Agentic Harness Arena — blind judging UI

Agentic Harness Arena runs the same task through multiple agent harnesses — Claude Code, Codex CLI, and more — holding the model constant, collects their deliverables in isolated workspaces, and lets people judge the results blind. Identities are only revealed after a score is submitted, and every verdict rolls up into a public Elo leaderboard.

If you've used Chatbot Arena to compare *models*, this is the same idea one layer up: comparing the *harness* — the CLI, tools, prompts, permissions, and execution environment wrapped around a model.

Contents

Why Harness Arena?

The model is only one part of an agentic workflow. The harness — the CLI, tools, prompts, permissions, and execution environment — shapes the quality of the final result just as much. Two harnesses running the identical model