Scraping Eagle โ DevOps skill for Claude Code
๐ฆ Scraping Eagle: web scraping skill & CLI for Claude Code and AI agents.
How to install Scraping Eagle
This entry records only its repository, not the path inside it, so there is no
exact command to give. Open dshakers/scraping-eagle and copy the folder into
~/.claude/skills/, or the file into ~/.claude/agents/.
What Scraping Eagle does
๐ฆ Scraping Eagle: web scraping skill & CLI for Claude Code and AI agents. One command scrapes any website โ Cloudflare/anti-bot bypass, JavaScript rendering, structured extraction to CSV/JSON, YouTube transcripts, Reddit, X, LinkedIn, Amazon, Shopify and full-site crawls to Markdown for RAG.
Alternatives in DevOps
- Appwrite โ Appwriteยฎ - complete cloud infrastructure for your web, mobile and AI apps 57.5k โ
- Claudable โ Claudable is an open-source web builder that leverages local CLI agents, such as Claude Code, Codex, Gemini CL 4k โ
- Cloudflare Commands โ Cloudflare CLI commands reference 665 โ
README
๐ฆ Scraping Eagle
**The web scraping skill and CLI for Claude Code and AI agents.**
One command, `scrape URL`, turns any website into clean Markdown, JSON or CSV.
Past Cloudflare and JavaScript, on your own machine, with no API keys.
[](LICENSE)    
What is Scraping Eagle?
Scraping Eagle is an open-source web scraping CLI and Claude Code skill created by [dshakers](#author). It gives AI coding agents and developers a single command, `scrape`, that fetches any web page, escalates on its own from a fast HTTP request to a stealth browser when a site blocks bots, and returns clean Markdown, JSON or CSV. It runs locally, is free, and needs no API keys.
scrape https://example.com/article # any page โ clean Markdown
scrape "https://www.youtube.com/watch?v=aircAruvnKk" # video โ metadata + transcript
scrape URL --each ".card" --field "name=h3::text" --field "price=.price::text" --csv
scrape search "best open source vector database" # web search, no key
scrape crawl https://docs.example.com --max-pages 100 # whole site โ Markdown for RAG
_Version 1.0.0 ยท every route last verified live on 2 October 2026._
Quick start
git clone https://github.com/dshakers/scraping-eagle ~/.claude/skills/scraping-eagle
bash ~/.claude/skills/scraping-eagle/scripts/setup.sh
scrape doctor --online
`setup.sh` builds an isolated environment in `~/.scraping-eagle` (about 400 MB with the browser, 1โ2 minutes) and links the `scrape` command into `~/.local/bin`. It never touches your system Python.
**Requirements:**
Related Skills
Skill
Web extraction engine with antibot bypass. Scrape, crawl, extract, summarize, search, map, diff, monitor, rese
Claude Code Skill Scrapling
Claude Code skill for web scraping with scrapling - auto Fetcher selection, Cloudflare bypass, site patterns
Web Preflight
Agent skill for a pre-launch website check on a site you own: before you deploy, it looks for exposed .env, .g
MCP Stealth Chrome
Stealth Chrome MCP server โ 100++ tools for AI agents. One-liner Cloudflare Turnstile bypass (proven), dual-mo
Agent Bypass Worker
โก Serverless Cloudflare Worker proxy for AI Coding Agents (Claude Code, OpenAI, Gemini, Telegram)
Docker Claudebox
Claude Code in Docker. Drop-in OpenAI-compatible API, MCP server, Telegram bot, and CLI โ five interfaces, one
Related Agents
Firecrawl Expert
Expert in Firecrawl API for web scraping, crawling, and structured data extraction. Handles dynamic content, a
Enrichment
Enrich a Notion lead row with company information via Firecrawl. Reads the row, scrapes the company's website,
Browser Stealth Agent
Stealth browser automation agent for targets behind Cloudflare, Akamai, Google, DataDome, or PerimeterX bot de