Claude Code Skill Scrapling banner
Cedriccmh Cedriccmh

Claude Code Skill Scrapling

DevOps community

Description

Claude Code skill for web scraping with scrapling - auto Fetcher selection, Cloudflare bypass, site patterns

Installation

This entry records only its repository, not the path inside it, so there is no exact command to give. Open the source below and copy the folder into ~/.claude/skills/, or the file into ~/.claude/agents/.

README

Claude Code Skill: Scrapling

[English](#english) | [中文](#中文)


English

A [Claude Code](https://docs.anthropic.com/en/docs/claude-code) skill for web scraping and data extraction using [scrapling](https://github.com/D4Vinci/Scrapling).

Automatically selects the best Fetcher based on target website characteristics, generates and executes Python scripts.

Features

  • Fetcher Decision Tree — Auto-select between Fetcher, StealthyFetcher, DynamicFetcher, FetcherSession, or Selector
  • Cloudflare Bypass — Built-in support for Cloudflare/WAF protected sites via StealthyFetcher (Camoufox)
  • Session Login — HTTP form-based login with cookie persistence
  • Site Pattern Library — Reusable patterns for common site types (Discourse, SPA, static blogs, APIs)
  • Cookie Vault — Local storage for login cookies with per-site templates
  • Troubleshooting Guide — Solutions for common errors indexed by error message

Installation

1. Install scrapling

pip install "scrapling[fetchers]"
scrapling install  # Install browser dependencies

2. Install this skill

Copy the skill directory to your Claude Code skills folder:

# Copy to user-level skills (available in all projects)
cp -r . ~/.claude/skills/scrapling

# Or copy to a specific project
cp -r . /path/to/project/.claude/skills/scrapling

Structure

.
├── SKILL.md                           # Skill definition (entry point)
├── references/
│   ├── api-quick-ref.md               # Fetcher/Selector API cheat sheet
│   ├── cookie-vault.md                # Cookie storage template
│   ├── maintenance.md                 # Installation & upgrade guide
│   ├── site-patterns.md               # Site-specific scraping patterns
│   └── troubleshooting.md             # Error solutions
└── templates/
    ├── basic_fetch.py                 # Static page scraping
    ├── stealth_cloudflare.py          # Cloudflare bypass
    ├── session_login.py               # Login + mult