anthropics

Anthropic Tokenizer TypeScript — AI skill for Claude Code

AI community

NPM version.

How to install Anthropic Tokenizer TypeScript

This entry records only its repository, not the path inside it, so there is no exact command to give. Open anthropics/anthropic-tokenizer-typescript and copy the folder into ~/.claude/skills/, or the file into ~/.claude/agents/.

What Anthropic Tokenizer TypeScript does

NPM version.

Alternatives in AI

  • Openskills — Universal skills loader for AI coding agents - npm i -g openskills 9.8k ★
  • Open Multi Agent — TypeScript multi-agent orchestration engine — one runTeam() call from goal to result 5.8k ★
  • Anthropic SDK TypeScript — Access to Anthropic's safety-first language model APIs in TypeScript 2.1k ★

README

Anthropic TypeScript Tokenizer

[![NPM version](https://img.shields.io/npm/v/@anthropic-ai/tokenizer.svg)](https://npmjs.org/package/@anthropic-ai/tokenizer)

⚠️ This package can be used to count tokens for Anthropic's older models. As of the Claude 3 models, this algorithm is no longer accurate, but can be used as a very rough approximation. We suggest that you rely on `usage` in the response body wherever possible.

Installation

npm install --save @anthropic-ai/tokenizer
# or
yarn add @anthropic-ai/tokenizer

Usage

import { countTokens } from '@anthropic-ai/tokenizer';

function main() {
  const text = 'hello world!';
  const tokens = countTokens(text);
  console.log(`'${text}' is ${tokens} tokens`);
}
main();

Status

This package is in beta. Its internals and interfaces are not stable and subject to change without a major semver bump; please reach out if you rely on any undocumented behavior.

We are keen for your feedback; please email us at [support@anthropic.com](mailto:support@anthropic.com) or open an issue with questions, bugs, or suggestions.

Requirements

The following runtimes are supported:

  • Node.js version 12 or higher.
  • Deno v1.28.0 or higher (experimental). Use import { countTokens } from "npm:@anthropic-ai/tokenizer".

If you are interested in other runtime environments, please open or upvote an issue on GitHub.