CodeJoust
Description
Pit AI coding agents against the same bug. Score them on tests, diff, cost, and time — pick the winning patch.
Installation
This entry records only its repository, not the path inside it, so there is no
exact command to give. Open the source below and copy the folder into
~/.claude/skills/, or the file into ~/.claude/agents/.
README
[](https://pypi.org/project/codejoust/) [](https://pypi.org/project/codejoust/) [](https://opensource.org/licenses/MIT)
[**Quickstart**](#quickstart) · [**How It Scores**](#how-it-scores) · [**Agents**](#agents) · [中文](README_CN.md)

Same model, different harness. Independent testing found Claude Sonnet scored **77% through Claude Code** but **93% through Cursor** on the same benchmark — a 15-point gap that is pure tooling, not model quality. Which "AI coding assistant" is right for your task is not a model question, it's a **task-level empirical question**.
CodeJoust answers it. One CLI command fires the same task at Claude Code, aider, Codex, Gemini CLI, Kimi Code in parallel — each in its own `git worktree` — then auto-grades them and hands you the winning patch.
Why not just open three terminals?
That's what most people do. It's also why most people never actually benchmark their tools — running three agents, waiting, eyeballing three diffs, manually tallying tokens is work, so they pick one and stick with it.
CodeJoust takes that hour down to one command:
codejoust run "fix the off-by-one in Scheduler.next_fire" \
--agents claude-code,aider,codex --test "pytest tests/test_scheduler.py"
You get:
- A side-by-side terminal table ranked by test pass-rate → cost → diff size → latency
- A single-file HTML report with each agent's full diff
- One
.patchfile per agent — apply the winner withgit apply
Install
pip install codejoust
You'll also need whichever agent CLIs you want to race. Install as many or as few as you like:
Related Skills
Agency Agents
A complete AI agency at your fingertips - From frontend wizards to Reddit community ninjas, from whimsy inject
AI Firecrawl
🔥 The API to search, scrape, and interact with the web for AI
AI Artifacts Builder
Suite of tools for creating elaborate, multi-component claude.ai HTML artifacts using modern frontend web tech
AI CrewAI
Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewA
AI TrendRadar
⭐AI-driven public opinion & trend monitor with multi-platform aggregation, RSS, and smart alerts.🎯 告别信息过载,你的
AI mem0
| Universal memory layer for AI Agents | 51341 | 221 | 1 |
AI