renezander030

Local AI Coding Stack — AI skill for Claude Code

AI community

Scripts and configs for running Claude Code against local LLMs (Ollama, LM Studio, llama.cpp, vLLM).

How to install Local AI Coding Stack

This entry records only its repository, not the path inside it, so there is no exact command to give. Open renezander030/local-ai-coding-stack and copy the folder into ~/.claude/skills/, or the file into ~/.claude/agents/.

What Local AI Coding Stack does

Scripts and configs for running Claude Code against local LLMs (Ollama, LM Studio, llama.cpp, vLLM). Companion to the local-LLM gist.

Alternatives in AI

Repomix — 📦 Repomix is a powerful tool that packs your entire repository into a single, AI-friendly file 22.7k ★
Inference Serving — ai-research-skills vLLM, SGLang, TensorRT-LLM, llama.cpp 5.4k ★
Minuet Ai.nvim — Code completion as-you-type from popular LLMs including OpenAI, Gemini, Claude, Ollama 1.1k ★

README

local-ai-coding-stack

A growing collection of scripts, configs, and notes for running Claude Code (and other coding agents) against **local LLMs** on Apple Silicon and Linux.

Companion to the gist:

[Claude Code with local LLMs and ANTHROPIC_BASE_URL: Ollama, LM Studio, llama.cpp, vLLM](https://gist.github.com/renezander030/39249215616a095d74fe6c66b0348641)

What's here

scripts/
└── start-claude-code-local.sh   — drop-in starter for Ollama + Claude Code with sane defaults (32K context, Gemma 4 26B-A4B)

More to come — LM Studio launchers, llama.cpp build presets, LiteLLM router configs, VS Code workspace settings.

Quick start

git clone https://github.com/renezander030/local-ai-coding-stack
cd local-ai-coding-stack/scripts
chmod +x start-claude-code-local.sh
./start-claude-code-local.sh

Override defaults via env:

OLLAMA_CONTEXT_LENGTH=65536 \
ANTHROPIC_DEFAULT_OPUS_MODEL=qwen3-coder \
./start-claude-code-local.sh

Recommended starting point

Backend: Ollama (≥ v0.14.0) or LM Studio (≥ 0.4.1)
Model: gemma4:26b-a4b (Gemma 4 26B-A4B-it Q4)
Context: 32K on a MacBook Air, 64K on a MacBook Pro M5 Pro/Max
Machine: 32 GB+ RAM strongly preferred

The gist has the full hardware × model × context × backend matrix and the debug flow when something breaks.

Contributing

PRs welcome for additional scripts, alternate backends, or hardware presets. Comment on the gist if you've verified a config on a different Mac/RAM/model combo.