carloslfu

Slotstream — AI skill for Claude Code

AI community

Run a 105 GB AI model on a Mac that can't hold it.

How to install Slotstream

This entry records only its repository, not the path inside it, so there is no exact command to give. Open carloslfu/slotstream and copy the folder into ~/.claude/skills/, or the file into ~/.claude/agents/.

What Slotstream does

Run a 105 GB AI model on a Mac that can't hold it. Slotstream streams Qwen3.8-Flash-Next (125B mixture of experts) from your SSD and caches the busiest experts in memory, so it runs on Macs with 16 to 64 GB. One native Swift binary on MLX and Metal, no Python, offline. Works with Claude Code, Codex and Ollama or OpenAI clients.

Alternatives in AI

System Prompts Leaks — Extracted system prompts from ChatGPT (GPT-5.4, GPT-5.3, Codex), Claude (Opus 4.6, Sonnet 4.6, Claude Code), G 38.6k ★
Qwen Code — A command-line AI workflow tool adapted from Gemini CLI, optimized for Qwen3-Coder models with enhanced parser 20.8k ★
Optimization — ai-research-skills AWQ, GPTQ, GGUF, Flash Attention, bitsandbytes 5.4k ★

README

slotstream

[![Latest release](https://img.shields.io/github/v/release/carloslfu/slotstream?label=latest%20release)](https://github.com/carloslfu/slotstream/releases/latest) [![GitHub stars](https://img.shields.io/github/stars/carloslfu/slotstream?style=flat&logo=github&label=stars)](#star-history)

**Run a 105 GB AI model on a Mac that can't hold it.**

Slotstream runs [Qwen3.8-Flash-Next](https://huggingface.co/pipenetwork/Qwen3.8-Flash-Next-MLX-4bit), a 125-billion-parameter open model, on Macs with 16 to 64 GB of memory. It keeps most of the model on the SSD and loads the parts it needs as it writes. Our 48 GB M5 Pro measured 15.86 tokens per second at a 22 GB memory target ([how it was measured](#speed)).

Chat with it, ask it about pictures, or code with it: `slotstream launch claude` starts Claude Code on the local model, and Codex, Pi, opencode and Hermes work the same way. Developers can connect their own apps through its Ollama-, OpenAI- and Anthropic-compatible APIs or its Swift library.

After a one-time download it works offline, with no Python and no cloud account. The whole engine is one native Swift program on Apple's MLX and Metal; see [Built native](#built-native). Every published number has a recorded method, and the experiments that failed stay in the [measurements](MEASUREMENTS.md).

[Get started](#install) · [Speed](#speed) · [Guides](#guides) · [Get help](#support)

**I'm building Sevra on Slotstream: private, personal AI optimized for your computer.** Sevra will choose a tested model for your hardware, keep that choice current as models improve, and let you control what it remembers. The Mac app is in development and runs Slotstream in process; see [how it is built](docs/SEVRA-MAC.md) and [join the waitlist](https://www.sevrahq.com/). Slotstream's command-line tool, APIs and Swift library remain independently usable.