Open Agent Sdk

Open Agent SDK

Build production-ready AI agents in minutes using your own hardware

**What you can build:**

• Copy editors that analyze manuscripts and track writing patterns
• Git commit generators that write meaningful commit messages
• Market analyzers that research competitors and summarize findings
• Code reviewers, data analysts, research assistants, and more

**Why local?**

• No API costs - use your hardware, not OpenAI's
• Privacy - your data never leaves your machine
• Control - pick your model (Qwen, Llama, Mistral, etc.)

**How fast?** From zero to working agent in under 5 minutes. Familiar patterns (inspired by Claude SDK), batteries-included features (streaming, tools, hooks, auto-execution), and production-ready quality.

[](https://pypi.org/project/open-agent-sdk/) [](https://www.python.org/downloads/) [](https://opensource.org/licenses/MIT)

---

Overview

Open Agent SDK provides a clean, streaming API for working with OpenAI-compatible local model servers. Drop-in similar patterns to popular SDKs, working with LM Studio, Ollama, llama.cpp, and any OpenAI-compatible endpoint—complete with streaming, tool call aggregation, hooks, and automatic tool execution.

Supported Providers

✅ Supported (OpenAI-Compatible Endpoints)

• LM Studio - http://localhost:1234/v1
• Ollama - http://localhost:11434/v1
• llama.cpp server - OpenAI-compatible mode
• vLLM - OpenAI-compatible API
• Text Generation WebUI - OpenAI extension
• Any OpenAI-compatible local endpoint
• Local gateways proxying cloud models - e.g., Ollama or custom gateways that route to cloud providers

❌ Not Supported (Use Official SDKs)

• Claude/OpenAI direct - Use their official SDKs, unless you proxy through a local