CodeJoust banner
he-yufeng he-yufeng

CodeJoust

AI community

Description

Pit AI coding agents against the same bug. Score them on tests, diff, cost, and time — pick the winning patch.

Installation

This entry records only its repository, not the path inside it, so there is no exact command to give. Open the source below and copy the folder into ~/.claude/skills/, or the file into ~/.claude/agents/.

README

CodeJoust — pit AI coding agents against the same bug

[![PyPI](https://img.shields.io/pypi/v/codejoust.svg)](https://pypi.org/project/codejoust/) [![Python](https://img.shields.io/pypi/pyversions/codejoust.svg)](https://pypi.org/project/codejoust/) [![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)

[**Quickstart**](#quickstart) · [**How It Scores**](#how-it-scores) · [**Agents**](#agents) · [中文](README_CN.md)

codejoust run


Same model, different harness. Independent testing found Claude Sonnet scored **77% through Claude Code** but **93% through Cursor** on the same benchmark — a 15-point gap that is pure tooling, not model quality. Which "AI coding assistant" is right for your task is not a model question, it's a **task-level empirical question**.

CodeJoust answers it. One CLI command fires the same task at Claude Code, aider, Codex, Gemini CLI, Kimi Code in parallel — each in its own `git worktree` — then auto-grades them and hands you the winning patch.

Why not just open three terminals?

That's what most people do. It's also why most people never actually benchmark their tools — running three agents, waiting, eyeballing three diffs, manually tallying tokens is work, so they pick one and stick with it.

CodeJoust takes that hour down to one command:

codejoust run "fix the off-by-one in Scheduler.next_fire" \
  --agents claude-code,aider,codex --test "pytest tests/test_scheduler.py"

You get:

  • A side-by-side terminal table ranked by test pass-rate → cost → diff size → latency
  • A single-file HTML report with each agent's full diff
  • One .patch file per agent — apply the winner with git apply

Install

pip install codejoust

You'll also need whichever agent CLIs you want to race. Install as many or as few as you like: