avivsinai

Litellm Rust — Development skill for Claude Code

Development community

Minimal Rust SDK port of LiteLLM – unified async client for OpenAI, Anthropic, Gemini, and xAI.

How to install Litellm Rust

This entry records only its repository, not the path inside it, so there is no exact command to give. Open avivsinai/litellm-rust and copy the folder into ~/.claude/skills/, or the file into ~/.claude/agents/.

What Litellm Rust does

Minimal Rust SDK port of LiteLLM – unified async client for OpenAI, Anthropic, Gemini, and xAI.

Alternatives in Development

Claude API — Build apps with the Claude API or Anthropic SDK 94.1k ★
OpenAI Codex CLI — (Rust implementation) 67.8k ★
Anthropic SDK Python — PyPI version 3.9k ★

README

litellm-rust

[![CI](https://github.com/avivsinai/litellm-rust/actions/workflows/ci.yml/badge.svg)](https://github.com/avivsinai/litellm-rust/actions/workflows/ci.yml) [![crates.io](https://img.shields.io/crates/v/litellm-rust.svg)](https://crates.io/crates/litellm-rust) [![docs.rs](https://docs.rs/litellm-rust/badge.svg)](https://docs.rs/litellm-rust) [![License: MIT](https://img.shields.io/badge/License-MIT-blue.svg)](LICENSE) [![Rust: 1.88+](https://img.shields.io/badge/rust-1.88%2B-orange.svg)](https://www.rust-lang.org/)

Minimal Rust SDK port of [LiteLLM](https://github.com/BerriAI/litellm) (library only). Provides a unified interface for chat, embeddings, images, and video across multiple LLM providers.

**Note**: This project is under active development. APIs may change.

Features

Unified client for OpenAI-compatible, Anthropic, Gemini, xAI, and Z.AI providers
Chat completions with streaming (SSE) support
Tool calling — model-requested function calls surfaced on ChatResponse.tool_calls in OpenAI shape (Anthropic tool_use and Gemini functionCall normalized through the same shape)
Text embeddings
Image generation (OpenAI DALL-E / GPT Image)
Video generation (Gemini Veo, OpenAI Sora)
Model routing with provider/model format
Automatic retry with exponential backoff
Cost tracking via response headers
Embedded model registry with pricing and context window data
Daily model registry refreshes from LiteLLM's canonical catalog