langchain-ai

Langsmith CLI — Development skill for Claude Code

Development community

A coding agent-first CLI for interacting with LangSmith.

How to install Langsmith CLI

This entry records only its repository, not the path inside it, so there is no exact command to give. Open langchain-ai/langsmith-cli and copy the folder into ~/.claude/skills/, or the file into ~/.claude/agents/.

What Langsmith CLI does

A coding agent-first CLI for interacting with LangSmith.

Alternatives in Development

Letta Code — The memory-first coding agent 2.4k ★
Alethe Agents — A local-first desktop workspace for running, organizing, and resuming multiple coding agents and shells with r 511 ★
Lacp — Local-first policy, evidence, memory, and recovery controls for Claude, Codex, Hermes, and other CLI coding ag 300 ★

README

langsmith-cli

An agent-first CLI for querying and managing [LangSmith](https://smith.langchain.com) resources.

Built for AI coding agents (deepagents, Claude Code, Cursor, etc.) and developers who need fast, scriptable access to projects, traces, runs, datasets, evaluators, experiments, and threads.

Installation

Install script (recommended)

macOS / Linux:

curl -fsSL https://cli.langsmith.com/install.sh | sh

Windows (PowerShell):

irm https://cli.langsmith.com/install.ps1 | iex

Upgrade

langsmith self-update

GitHub releases

Download the latest binary for your platform from [GitHub Releases](https://github.com/langchain-ai/langsmith-cli/releases).

Authentication

Set your API key as an environment variable:

export LANGSMITH_API_KEY="lsv2_pt_..."

Optionally set defaults:

export LANGSMITH_ENDPOINT="https://api.smith.langchain.com"  # For self-hosted
export LANGSMITH_WORKSPACE_ID=""                # Default workspace
export LANGSMITH_PROJECT="my-default-project"                 # Default project for queries

Or save the credentials in a profile:

langsmith auth login                    # OAuth
langsmith profile create prod           # API key, taken from $LANGSMITH_API_KEY

Profiles live in `~/.langsmith/config.json`, written owner-only; the CLI warns if it is readable by other users.

Other settings can be passed as flags:

langsmith --workspace  trace list --project my-app

Quick Start

# List tracing projects
langsmith project list

# List recent traces in a project
langsmith trace list --project my-app --limit 5

# Get a specific trace with full detail
langsmith trace get  --project my-app --full

# List LLM calls with token counts
langsmith run list --project my-app --run-type llm --include-metadata

# List datasets
langsmith dataset list

# List experiments for a dataset
langsmith experiment lis