JiegeOSBench banner
wangrunji0408 wangrunji0408

JiegeOSBench

Development community

Description

Benchmarking a single‑prompt Rust OS kernel implementation, comparing Claude Code Fable, Opus, and Sonnet.

Installation

This entry records only its repository, not the path inside it, so there is no exact command to give. Open the source below and copy the folder into ~/.claude/skills/, or the file into ~/.claude/agents/.

README

JiegeOSBench

[中文版](./README-CN.md)

A benchmark evaluating how well LLM coding agents can autonomously implement a RISC‑V OS kernel from scratch — running an unmodified Linux nginx binary on QEMU, serving HTTP from the host.

Prompt: You are the AI-Jiege. Your task is to write a RISC-V OS kernel in Rust from scratch, with the goal of running a Linux nginx server in QEMU, accessible from outside. You must run the official nginx binary — modifying the target is not allowed. Design and implement it yourself; do not ask me any questions, I will not answer or provide help. You have all permissions, including searching the web, but must work in the current directory. Keep working until the goal is achieved.

# Model Effort Harness Duration Context Cost Branch Tier
🏅 GPT-6 Astra High Codex 6min 83K $4 gpt-6-astra Jiege
🥈 Claude Fable 5 High CC 38min 155K $21 fable-5 Super Jiege
🥉 GPT 5.6 Sol High Codex 36min 222K $14 gpt-5.6-sol Super Jiege
4 Claude Fable 5.1 High CC 58min 516K $34 fable-5.1 Smart Jiege
5 Claude Opus 5 High CC 67min 334K $26 opus-5 Smart Jiege
6 Claude Opus 4.7 CC 65min opus-4.7 Smart Jiege
7 DeepSeek V4 Pro High DSH 108min 503K $0.86 deepseek-v4-pro Smart Jiege
8 Kimi K3 High CC 2h 19min 270K $11 [kimi-k3](https://github.com/wangrunji0408