lukaszraczylo

Traefik Llmgateway — AI skill for Claude Code

AI community

Traefik plugin doing what every LLM gateway would do.

How to install Traefik Llmgateway

This entry records only its repository, not the path inside it, so there is no exact command to give. Open lukaszraczylo/traefik-llmgateway and copy the folder into ~/.claude/skills/, or the file into ~/.claude/agents/.

What Traefik Llmgateway does

Traefik plugin doing what every LLM gateway would do.

Alternatives in AI

  • Axonhub — ⚡️ Open-source AI Gateway — Use any SDK to call 100+ LLMs 3.2k ★
  • Coding Agent Template — Multi-agent AI coding platform powered by Vercel Sandbox and AI Gateway 1.8k ★
  • Paritok 4b V1 — Non-destructive compression gateway for AI coding agents 1.4k ★

README

traefik-llmgateway

A [Traefik](https://traefik.io) middleware plugin that turns a Traefik instance into a multi-provider LLM gateway: one endpoint, several upstream providers, per-user API keys organised into groups, request/token/cost limits, and a registry plus authenticated proxy for in-cluster MCP servers and A2A agents.

It runs in either of two forms from this one codebase — as a [Yaegi](https://github.com/traefik/yaegi)-interpreted Traefik middleware plugin, the same way [`traefikoidc`](https://github.com/lukaszraczylo/traefikoidc) does, configured per-middleware in Traefik's dynamic configuration; or as a standalone compiled binary sitting behind Traefik. The plugin form needs no sidecar and no companion service; the binary form exists because streaming arrives token-by-token there and buffered in the plugin. See [Deployment modes](#deployment-modes).

**Status:** stable at **v1.0**. Configuration keys, endpoints, and behaviour now follow semver — breaking changes wait for a major release instead of landing between patches, as they could before 1.0.

Feature-complete, all gates green (unit tests, `-race`, `yaegi-check`, integration), and published to the Traefik Plugin Catalog. One behaviour worth knowing before you deploy: [streaming is delivered buffered rather than token-by-token](#known-limitations) under the current Traefik + Yaegi combination — which is exactly what running the [standalone binary](#deployment-modes) instead fixes.

What it is

  • A unified, OpenAI-compatible surface (/v1/chat/completions, /v1/embeddings, /v1/models) that translates requests and responses to and from Anthropic's and Google Gemini's own wire formats, so any OpenAI-SDK-compatible client can talk to all three providers through one API shape.
  • An Anthropic-compatible surface (POST /v1/messages) for Anthropic SDK clients — including Claude Code — to talk to any configured provider in Anthropic's own Messages API shape; see [Anthropic Messages API