san-tian

Smg — Data skill for Claude Code

Data community

Engine-agnostic LLM gateway in Rust.

How to install Smg

This entry records only its repository, not the path inside it, so there is no exact command to give. Open san-tian/smg and copy the folder into ~/.claude/skills/, or the file into ~/.claude/agents/.

What Smg does

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.

Alternatives in Data

  • Private GPT — Complete API layer for private AI applications on local models: RAG, skills, tools, MCP, text-to-sql, and more 57.5k ★
  • Claude Deep Research Skill — Enterprise-grade deep research skill for Claude Code with 8-phase pipeline, source credibility scoring, and au 1k ★
  • SEO Rank Tracking — Track search engine rankings 397 ★

README

SMG Logo

Shepherd Model Gateway

Release Docker PyPI License Docs Discord Slack Ask DeepWiki PyTorch Blog

Engine-agnostic, high-performance model-routing gateway for large-scale LLM deployments. SMG centralizes worker lifecycle management, balances traffic across se