kmmuntasir

Nano LLM Proxy — AI skill for Claude Code

AI community

Tiny single-binary LLM gateway — pool multiple providers and API keys behind one OpenAI/Anthropic-compatible endpoint, with smart key rotation and an embedded admin GUI.

How to install Nano LLM Proxy

This entry records only its repository, not the path inside it, so there is no exact command to give. Open kmmuntasir/nano-llm-proxy and copy the folder into ~/.claude/skills/, or the file into ~/.claude/agents/.

What Nano LLM Proxy does

Tiny single-binary LLM gateway — pool multiple providers and API keys behind one OpenAI/Anthropic-compatible endpoint, with smart key rotation and an embedded admin GUI.

Alternatives in AI

Pixel Agents — Compressed Reference — VS Code extension with embedded React webview: pixel art office where AI agents (Claude Code terminals) are an 6.5k ★
Embeddedskills — An open-source collection of embedded development and debugging skills for Claude Code, Copilot, TRAE, and oth 593 ★
Claudexor — Multi-harness control plane for Claude Code, Codex, Cursor, and OpenCode: quota-aware rotation across multiple 425 ★

README

nano-llm-proxy

[![Go](https://img.shields.io/badge/Go-1.26%2B-00ADD8?logo=go&logoColor=white)](https://go.dev) [![License: GPL v3](https://img.shields.io/badge/License-GPLv3-blue.svg)](https://www.gnu.org/licenses/gpl-3.0) [![CI](https://github.com/kmmuntasir/nano-llm-proxy/actions/workflows/ci.yml/badge.svg)](https://github.com/kmmuntasir/nano-llm-proxy/actions/workflows/ci.yml) [![Go Report](https://img.shields.io/badge/go_report-A00000?style=flat-square)](https://pkg.go.dev/github.com/kmmuntasir/nano-llm-proxy)

**A tiny, single-binary LLM gateway. Five direct Go dependencies, all pure Go — no cgo, no container runtime, no Postgres.** One static binary plus one SQLite file is the entire deployment.

[![Release](https://img.shields.io/github/v/release/kmmuntasir/nano-llm-proxy?label=release)](https://github.com/kmmuntasir/nano-llm-proxy/releases/latest) [![License](https://img.shields.io/github/license/kmmuntasir/nano-llm-proxy)](LICENSE)

Pool several upstream providers and their API keys behind one endpoint that speaks **OpenAI chat**, **OpenAI Responses**, and **Anthropic Messages** — with health-tracking key rotation, an embedded admin GUI, and no runtime dependencies beyond a single SQLite file.

Think "personal API gateway for language models": point your scripts, IDE extensions, and CLI agents at one URL with one key, while the gateway rotates a pool of upstream keys, survives rate limits and flaky upstreams, and shows you what happened in a web UI.

**No Docker, no sidecars, no Postgres, no control plane.** One static binary plus one SQLite file is the entire deployment. `sudo ./deploy.sh` builds it and installs a hardened systemd unit. The whole point is that you can drop it on a cheap VPS, a NAS, or a laptop and have a working gateway in under a minute — the same job most gateways make you spin up a container and a database for.