Release

Webdown

[](https://github.com/kelp/webdown/actions/workflows/python-tests.yml) [](https://codecov.io/gh/kelp/webdown) [](https://badge.fury.io/py/webdown) [](https://pypi.org/project/webdown/) [](https://opensource.org/licenses/MIT)

A Python CLI tool for converting web pages to clean, readable Markdown format. Webdown makes it easy to download documentation and feed it into an LLM coding tool.

Why Webdown?

• Clean Conversion: Produces readable Markdown without formatting artifacts
• Multi-Page Crawling: Crawl entire documentation sites with webdown crawl
• Selective Extraction: Target specific page sections with CSS selectors
• Claude XML Format: Optimized output format for Anthropic's Claude AI models
• Progress Tracking: Visual download progress for large pages with -p flag
• Optimized Handling: Automatic streaming for large pages (>10MB) with no configuration required

Use Cases

Documentation for AI Coding Assistants

Webdown is particularly useful for preparing documentation to use with AI-assisted coding tools like Claude Code, GitHub Copilot, or ChatGPT:

• Convert technical documentation into clean Markdown for AI context
• Extract only the relevant parts of large documentation pages using CSS selectors
• Strip out images and formatting that might consume token context
• Generate well-structured tables of contents for better navigation

# Example: Convert API docs and store for AI coding context
webdown https://api.example.com/docs -s "main" -I -c -w 80 -o api_context.md

Installation

From PyPI

pip install webdown

With Homebrew

# Add the tap
brew tap kelp/tools

# Install webdown
brew install webdown

Install from Source

# Clone the repository
git clone https://github.com/kelp/webdown.git
cd webdown

# Install with pip
pip install .

# Or install with Poetry
poetry install

Usage

Basic usage:

...