Inference Serving — AI skill for Claude Code
ai-research-skills vLLM, SGLang, TensorRT-LLM, llama.cpp.
How to install Inference Serving
This entry records only its repository, not the path inside it, so there is no
exact command to give. Open Orchestra-Research/AI-Research-SKILLs and copy the folder into
~/.claude/skills/, or the file into ~/.claude/agents/.
What Inference Serving does
ai-research-skills vLLM, SGLang, TensorRT-LLM, llama.cpp.
One of 7 entries listed from Orchestra-Research/AI-Research-SKILLs. The repository README
describes the whole collection, not this skill — read it on GitHub.
Alternatives in AI
- Repomix — 📦 Repomix is a powerful tool that packs your entire repository into a single, AI-friendly file 22.7k ★
- Deepreasoning — A high-performance LLM inference API and Chat UI that integrates DeepSeek R1's CoT reasoning traces with Anthr 5.4k ★
- LLM For Zotero — An open-sourced research agent system deeply rooted in your Zotero library 2.8k ★
Related Skills
ML Production
Use when shipping ML models (classical or LLM) to production - quantization (torch.ao.quantization, AWQ/GPTQ/A
HomeAILab
Home AI inference lab running Qwen3.8 across RTX 5090, RTX 3090, and DGX Spark with vLLM, llama.cpp, custom Go
Superfluid
One serving daemon for local LLM agents: durable sessions, QoS scheduling and OpenAI, Anthropic and Ollama API
AIonDemandCluster
Spin up any open LLM on rented GPUs (vast.ai/RunPod), serve it with vLLM or llama.cpp, and drive it from Claud
Quackd
🦆🧠 Give your Microduck a brain. Tell a small robot with two legs what you want in plain language. An LLM (Cl
Local AI Coding Stack
Scripts and configs for running Claude Code against local LLMs (Ollama, LM Studio, llama.cpp, vLLM). Companion
Related Agents
Incident Investigator
Investigates an LLM-serving incident (vLLM or SGLang) in an isolated context. Reads long runtime logs, runs th
Inference Architect
You are the system Inference Architect — a senior ML infrastructure engineer specializing in local LLM serving
Aiml Engineer
AI/ML integration specialist. Designs model pipelines (inference, fine-tuning, LoRA adapters), selects infrast
