AI CLI Observability — AI skill for Claude Code

AI CLI Observability

**See where your AI coding time, tokens, and money go.**

[](https://opentelemetry.io/) [](https://grafana.com/) [](https://docs.docker.com/compose/) [](LICENSE)

AI CLI Observability turns the built-in telemetry from **Codex**, **Claude Code**, and **Gemini CLI** into one self-hosted Grafana view. Track usage, latency, errors, tokens, tool activity, traces, and estimated API-equivalent cost without sending your telemetry to another SaaS.

One Compose stack. Three AI CLIs. Full OpenTelemetry signals. Your data.

Answer	Signal
Which CLI and model consume the most tokens?	Usage and token metrics
What would that activity cost through provider APIs?	USD and EUR estimates
Where do slow requests and failures happen?	Latency, errors, logs, and traces
Which tools are agents actually using?	Immutable tool events

Quick start

**You need:** Docker with Compose v2. Python 3.11 or newer is required only for the smoke test.

Copy the environment template and generate two secrets:

cp .env.example .env
openssl rand -hex 32
openssl rand -hex 32

Paste one value into `OTEL_AUTH_TOKEN` in `.env` and the other into `GRAFANA_ADMIN_PASSWORD`, then start the stack:

docker compose up -d --build
docker compose ps

Open , sign in with `admin` and your Grafana password, then connect a clie