Cedriccmh

Claude Code Skill Scrapling — DevOps skill for Claude Code

DevOps community

Claude Code skill for web scraping with scrapling - auto Fetcher selection, Cloudflare bypass, site patterns.

How to install Claude Code Skill Scrapling

This entry records only its repository, not the path inside it, so there is no exact command to give. Open Cedriccmh/claude-code-skill-scrapling and copy the folder into ~/.claude/skills/, or the file into ~/.claude/agents/.

What Claude Code Skill Scrapling does

Claude Code skill for web scraping with scrapling - auto Fetcher selection, Cloudflare bypass, site patterns.

Alternatives in DevOps

CLAUDE.md CI/CD Wiki — Community patterns for CLAUDE.md configuration in CI/CD pipelines 22.3k ★
Terraform Skill For Claude — Comprehensive Terraform and OpenTofu guidance covering testing, modules, CI/CD, and production patterns 1.4k ★
Proxy — route Claude Code requests through multiple upstream providers (OpenCode Go, OpenCode Zen, and AWS Bedrock) wi 957 ★

README

Claude Code Skill: Scrapling

[English](#english) | [中文](#中文)

English

A [Claude Code](https://docs.anthropic.com/en/docs/claude-code) skill for web scraping and data extraction using [scrapling](https://github.com/D4Vinci/Scrapling).

Automatically selects the best Fetcher based on target website characteristics, generates and executes Python scripts.

Features

Fetcher Decision Tree — Auto-select between Fetcher, StealthyFetcher, DynamicFetcher, FetcherSession, or Selector
Cloudflare Bypass — Built-in support for Cloudflare/WAF protected sites via StealthyFetcher (Camoufox)
Session Login — HTTP form-based login with cookie persistence
Site Pattern Library — Reusable patterns for common site types (Discourse, SPA, static blogs, APIs)
Cookie Vault — Local storage for login cookies with per-site templates
Troubleshooting Guide — Solutions for common errors indexed by error message

Installation

1. Install scrapling

pip install "scrapling[fetchers]"
scrapling install  # Install browser dependencies

2. Install this skill

Copy the skill directory to your Claude Code skills folder:

# Copy to user-level skills (available in all projects)
cp -r . ~/.claude/skills/scrapling

# Or copy to a specific project
cp -r . /path/to/project/.claude/skills/scrapling

Structure

.
├── SKILL.md                           # Skill definition (entry point)
├── references/
│   ├── api-quick-ref.md               # Fetcher/Selector API cheat sheet
│   ├── cookie-vault.md                # Cookie storage template
│   ├── maintenance.md                 # Installation & upgrade guide
│   ├── site-patterns.md               # Site-specific scraping patterns
│   └── troubleshooting.md             # Error solutions
└── templates/
    ├── basic_fetch.py                 # Static page scraping
    ├── stealth_cloudflare.py          # Cloudflare bypass
    ├── session_login.py               # Login + mult