LeoYeAI

Myclaw Bench

Name: Myclaw Bench
Author: LeoYeAI

AI community

SOURCE https://github.com/LeoYeAI/myclaw-bench

Description

The definitive benchmark for AI agents on OpenClaw. 45 tasks across 4 tiers. Powered by MyClaw.ai

Installation

This entry records only its repository, not the path inside it, so there is no exact command to give. Open the source below and copy the folder into ~/.claude/skills/, or the file into ~/.claude/agents/.

README

MyClaw Bench 🦞

The definitive benchmark for which LLM runs OpenClaw best.

**Built from real-world usage data.**

[![Powered by MyClaw.ai](https://img.shields.io/badge/Powered%20by-MyClaw.ai-blue)](https://myclaw.ai)

Why Another Benchmark?

Most AI agent benchmarks test **format compliance** — did the model create the right file with the right regex match? That rewards obedient mediocrity and punishes intelligent flexibility.

MyClaw Bench tests what actually matters:

Dimension	What we test	What others miss
🎯 Outcome	Did the task actually get done?	Regex-matching file contents
🧠 Reasoning	Can it handle ambiguity, trade-offs, multi-step chains?	Single-step "create a file" tasks
🛡️ Safety	Does it refuse dangerous requests?	Assumed trust
⚡ Efficiency	How many tool calls / tokens to complete?	Only success rate
🔄 Resilience	Can it recover from tool failures?	Happy-path only
📊 Consistency	Same result across 5 runs?	Single-run scores

Task Categories

MyClaw Bench includes **45 tasks** across 4 difficulty tiers:

Tier 1: Foundation (10 tasks) — Can it do basic things right?

ID	Task	Category	Grading
F01	Sanity check	basic	automated
F02	File structure creation	file_ops	automated
F03	Config search & replace	file_ops	automated
F04	Read & answer from document	comprehension	automated
F05	Write a Python script (weather)	coding	automated
F06	Create calendar event (ICS)	productivity	automated
F07	Stock price research	research	automated
F08	Professional email draft	writing	ll