New Scraper — Development skill for Claude Code
Build a Scrape.do-powered scraper for a new site.
How to install New Scraper
Installs to ~/.claude/commands/automationbyexperts-claude-code-web-scraping-new-scraper.md
mkdir -p ~/.claude/commands && curl -fsSL https://raw.githubusercontent.com/automationbyexperts/claude-code-web-scraping/HEAD/.claude/commands/new-scraper.md -o ~/.claude/commands/automationbyexperts-claude-code-web-scraping-new-scraper.md Restart Claude Code, or start a new session, for it to be picked up.
What New Scraper does
description: Build a Scrape.do-powered scraper for a new site argument-hint: [what data you want]
Build a scraper for: $ARGUMENTS
Follow the "Building a scraper for a new site" rules in AGENTS.md and the `scrape-any-site` skill. In order:
account_infoto confirm the token works and see remaining credits.find_hidden_apison the URL. Report any JSON endpoint that carries the data.scrape_page(markdown) to see the data, then raw HTML or
Alternatives in Development
- Boss Zhipin Scraper — Boss直聘爬虫 / BOSS直聘职位数据抓取工具,基于 Chrome CDP 协议复用真实登录态,绕过字体反爬,输出明文薪资 JSON/CSV + 薪资技能分析 1.5k ★
- Scrape Jobs — List or clean up Google Maps scrape jobs 1.4k ★
- Claude Prism — An offline-first scientific writing workspace powered by Claude 1.1k ★
Full documentation available on GitHub
View Source RepositoryRelated Skills
Google Maps Scraper Skill
A Claude Code, Codex, and OpenClaw skill for Google Maps lead generation. Find and scrape local businesses, en
Scraper Discover
Systematic website reconnaissance. Classifies site architecture, discovers API endpoints, reverse-engineers au
Apify Collect
Collect job-posting URLs into ~/.dear-hiring-manager/urls.txt by running your Apify job scraper, for /batch.
Web Scraper
Intelligent web scraping Claude Code skill with automatic strategy selection and TypeScript-first Apify Actor
Customer Discovery Agent
Reddit pain-point scraper + Claude clustering with structured outputs. Find what users actually complain about
Bvp Minor Project
Pathfinder — agentic internship scraper (Gemini + OpenAI + Claude via OpenRouter)
Related Agents
Firecrawl Scraper
Web scraping and research subagent. Dispatched to scrape URLs, search the web, crawl sites, and extract struct
Prometheus Configuration
Complete guide to Prometheus setup, metric collection, scrape configuration, and recording rules. - wshobson/a
LinkedIn Analyst
Analyse un profil LinkedIn fourni par l'utilisateur (screenshots et texte collé) et le croise avec son GitHub.