Awesome Auditable Ai banner
yzhao062 yzhao062

Awesome Auditable Ai

AI community

Description

Auditing AI agents: a curated list of papers, tools, datasets, benchmarks, and standards covering reliability, monitoring, failure attribution, and decision records.

Installation

This entry records only its repository, not the path inside it, so there is no exact command to give. Open the source below and copy the folder into ~/.claude/skills/, or the file into ~/.claude/agents/.

README

Awesome Auditable AI [![Awesome](https://awesome.re/badge-flat2.svg)](https://awesome.re)

Awesome Auditable AI: a curated list for auditing AI agents

[![Verify README](https://github.com/yzhao062/awesome-auditable-ai/actions/workflows/verify.yml/badge.svg)](https://github.com/yzhao062/awesome-auditable-ai/actions/workflows/verify.yml) [![License: CC0-1.0](https://img.shields.io/badge/license-CC0--1.0-blue.svg)](https://creativecommons.org/publicdomain/zero/1.0/) [![PRs Welcome](https://img.shields.io/badge/PRs-welcome-blue.svg)](CONTRIBUTING.md) [![Last commit](https://img.shields.io/github/last-commit/yzhao062/awesome-auditable-ai)](https://github.com/yzhao062/awesome-auditable-ai/commits/main)

[!NOTE] **Auditability** is the goal: being able to establish what an agent did, what it relied on, why it acted, and whether the action was right. **Reliability engineering** is how a system gets there. An agent that behaves inconsistently, loses its trace under stress, or cannot attribute a failure to a step is one that cannot be audited afterwards, whatever records it keeps. This list therefore covers both: monitoring, robustness, fault tolerance, and failure attribution alongside decision records, accountability, and post-hoc review.

Maintained by the author of `auditable` and GRADE, two components of [The Auditable Agents Ecosystem](#the-auditable-agents-ecosystem). Every component is also listed in the topical section it belongs to, under the same inclusion bar as every other entry.

**Agent capability is rising much faster than agent reliability.** *Towards a Science of AI Agent Reliability* (ICML 2026) decomposes reliability into twelve metrics over fifteen models and finds that recent capability gains produced only small reliability gains. The cost of that gap shows up after a run rather than during it: in the original Who&When study (ICML 2025), the str