Inference Architect — DevOps & Infrastructure agent for Claude Code
You are the system Inference Architect — a senior ML infrastructure engineer specializing in local LLM serving, model optimization, GPU resource management, and inference routing across heterogene.
How to install Inference Architect
Installs to ~/.claude/agents/viriansemail-sys-claude-code-helper-inference-architect.md
mkdir -p ~/.claude/agents && curl -fsSL https://raw.githubusercontent.com/viriansemail-sys/Claude-Code-Helper/HEAD/agents/inference-architect.md -o ~/.claude/agents/viriansemail-sys-claude-code-helper-inference-architect.md Restart Claude Code, or start a new session, for it to be picked up.
What Inference Architect does
name: inference-architect model: opus color: red memory: user
You are **the system Inference Architect** — a senior ML infrastructure engineer specializing in local LLM serving, model optimization, GPU resource management, and inference routing across heterogeneous NVIDIA compute clusters. You understand that the system's intelligence runs on *local iron* — not cloud APIs — and every architectural decision you make affects response latency, model quality, and power consumption.
You thi
Alternatives in DevOps & Infrastructure
- Kubernetes Architect — You are a Kubernetes architect specializing in cloud-native infrastructure, modern GitOps workflows 31.9k ★
- Claudable — by Ethan Park - Claudable is an open-source web builder that leverages local CLI agents, such as Claude Code a 3.8k ★
- AWS Agent Skills — Supercharge Claude Code with AWS cloud engineering skills across 18 core AWS services 1k ★
Full documentation available on GitHub
View Source RepositoryRelated Agents
Aiml Engineer
AI/ML integration specialist. Designs model pipelines (inference, fine-tuning, LoRA adapters), selects infrast
MLOps
ML infrastructure specialist — training pipelines, model serving, GPU optimization, distributed training
CI Architect
CI/CD pipeline architect specializing in workflow configuration, job orchestration, and pipeline optimization.
MLOps Reviewer
MLOps and ML-infrastructure expert for the code-review panel. Spawned when the diff touches pipelines (Airflow
Issue Architect
Expert at formulating GitHub or Azure DevOps issues that are structured to be consumed as prompts by other LLM
AWS Integration
Configure and manage AWS integration for monitoring, log collection, and resource tracking across AWS accounts
Related Skills
Samzong
Inference Serving Stack: Scheduling and routing across heterogeneous models — the production path for vLLM and
Siphon
Siphon: a raw-C, zero-dependency GGUF inference engine for Linux. Runs giant models on modest hardware by spli
Inference Serving
ai-research-skills vLLM, SGLang, TensorRT-LLM, llama.cpp
