automationbyexperts

New Scraper — Development skill for Claude Code

Development community

Build a Scrape.do-powered scraper for a new site.

How to install New Scraper

Installs to ~/.claude/commands/automationbyexperts-claude-code-web-scraping-new-scraper.md

Terminal
mkdir -p ~/.claude/commands && curl -fsSL https://raw.githubusercontent.com/automationbyexperts/claude-code-web-scraping/HEAD/.claude/commands/new-scraper.md -o ~/.claude/commands/automationbyexperts-claude-code-web-scraping-new-scraper.md

Restart Claude Code, or start a new session, for it to be picked up.

What New Scraper does


description: Build a Scrape.do-powered scraper for a new site argument-hint: [what data you want]

Build a scraper for: $ARGUMENTS

Follow the "Building a scraper for a new site" rules in AGENTS.md and the `scrape-any-site` skill. In order:

  1. account_info to confirm the token works and see remaining credits.
  2. find_hidden_apis on the URL. Report any JSON endpoint that carries the data.
  3. scrape_page (markdown) to see the data, then raw HTML or

Alternatives in Development

  • Boss Zhipin Scraper — Boss直聘爬虫 / BOSS直聘职位数据抓取工具,基于 Chrome CDP 协议复用真实登录态,绕过字体反爬,输出明文薪资 JSON/CSV + 薪资技能分析 1.5k ★
  • Scrape Jobs — List or clean up Google Maps scrape jobs 1.4k ★
  • Claude Prism — An offline-first scientific writing workspace powered by Claude 1.1k ★

Full documentation available on GitHub

View Source Repository