Faibench Frontier InfraBench banner
one2piece2hello one2piece2hello

Faibench Frontier InfraBench

DevOps community

Description

Phi-Bench (Φ-Bench): 85 open-source LLM-infrastructure engineering tasks for frontier LLMs & coding agents (KFC/LH/E2E). Self-contained public Dockerfile + offline scoring + reference solution per task. Website: llminfrabench.com

Installation

This entry records only its repository, not the path inside it, so there is no exact command to give. Open the source below and copy the folder into ~/.claude/skills/, or the file into ~/.claude/agents/.

README

Φ-Bench: Can Large Language Models Engineer the Infrastructure That Powers Them?

*The **Frontier AI Infrastructure Benchmark** for evaluating frontier LLMs and autonomous coding agents on real-world **ML systems and LLM infrastructure engineering** — also written **FAI-Bench** / **ΦBench**.*

**85 open-source LLM-infrastructure engineering tasks** — build a public Docker image, solve the task offline, and score against a grader shipped with the package.

🔗 [faibench.org](https://faibench.org/)

[![License](https://img.shields.io/badge/license-Apache%202.0-blue.svg)](LICENSE)  ![tasks](https://img.shields.io/badge/tasks-85-brightgreen.svg)  [![Website](https://img.shields.io/badge/Website-faibench.org-2563EB?logo=googlechrome&logoColor=white)](https://faibench.org/)  [![Hugging Face Dataset](https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Dataset-FFD21E)](https://huggingface.co/datasets/faibench-Frontier-Infra-Bench/faibench_Frontier_Infra_Bench)  ![arXiv](https://img.shields.io/badge/arXiv-coming%20soon-B31B1B?logo=arxiv&logoColor=white)

🌐  **English**  ·  [简体中文](README.zh-CN.md)


Contents

Can LLMs Engineer the Infrastructure That Powers Them?

**Can LLMs Engineer the Infrastructure That Powers Them? To answer this question, we introduce Φ-Bench—the most comprehensive and realistic benchmark for LLM infrastructure engineering.**

✅ **Broadest coverage.** ✅ **Real-world engineering.** ✅ **Frontier-level difficulty.**

To bu