Docs Scraper — Development agent for Claude Code
name: docs-scraper description: Documentation scraping specialist.
How to install Docs Scraper
Installs to ~/.claude/agents/jayminwest-agentic-engineering-book-docs-scraper.md
mkdir -p ~/.claude/agents && curl -fsSL https://raw.githubusercontent.com/jayminwest/agentic-engineering-book/HEAD/.claude/agents/docs-scraper.md -o ~/.claude/agents/jayminwest-agentic-engineering-book-docs-scraper.md Restart Claude Code, or start a new session, for it to be picked up.
What Docs Scraper does
name: docs-scraper description: Documentation scraping specialist. Use proactively to fetch and save documentation from URLs as properly formatted markdown files. tools: mcp__firecrawl-mcp__firecrawl_scrape, WebFetch, Write, Edit model: sonnet color: blue output-style: narrative-technical
Purpose
You are a documentation scraping specialist that fetches content from URLs and saves it as properly formatted markdown files for offline reference and analysis.
Variables
**Output Style
Alternatives in Development
- Gitnexus Docs Dod Reviewer — GitNexus docs and Definition-of-Done reviewer 45.8k ★
- Docs Drift Review — Given a session's commits or diff, finds the docs that the change made wrong — stale paths and symbols, checkl 7.2k ★
- Docs Impact Agent — Finds repository documentation made false by a change and missing documentation required to use or operate a n 2.2k ★
Full documentation available on GitHub
View Source RepositoryRelated Agents
Model Scraper
Scraper
Autonomous scraping agent. Writes scripts, runs them, and produces all job deliverables.
LinkedIn Scraper
Use this sub-agent to orchestrate LinkedIn scraping for all qualified leads via Apify actors. Only ONE instanc
Daily Scraper
Daily Scraper — operating manual (v2, 2026-09-10)
CLI Developer
GAIA CLI development specialist. Use PROACTIVELY for adding or modifying gaia in src/gaia/cli.py, argparse wor
User Guide Expert
Use this agent when you need to create, update, or improve user-facing documentation in the docs/userguide dir
Related Skills
Migration Plan: Merge Maps-scraper-pro Into Google-maps-scraper
Migration Plan: Merge maps-scraper-pro into google-maps-scraper skill
Apify Collect
Collect job-posting URLs into ~/.dear-hiring-manager/urls.txt by running your Apify job scraper, for /batch.
Web Scraper
Intelligent web scraping Claude Code skill with automatic strategy selection and TypeScript-first Apify Actor