Scraping Compliance Reviewer — Data & AI agent for Claude Code
Use before adding or changing any data source that fetches third-party websites or APIs — checks Terms of Service, robots.txt, rate limits, attribution and GDPR exposure, and recommends an official AP.
How to install Scraping Compliance Reviewer
Installs to ~/.claude/agents/cursorcanis-weekend-getaway-deals-app-scraping-compliance-reviewer.md
mkdir -p ~/.claude/agents && curl -fsSL https://raw.githubusercontent.com/cursorcanis/weekend-getaway-deals-app/HEAD/.claude/agents/scraping-compliance-reviewer.md -o ~/.claude/agents/cursorcanis-weekend-getaway-deals-app-scraping-compliance-reviewer.md Restart Claude Code, or start a new session, for it to be picked up.
What Scraping Compliance Reviewer does
name: scraping-compliance-reviewer description: Use before adding or changing any data source that fetches third-party websites or APIs — checks Terms of Service, robots.txt, rate limits, attribution and GDPR exposure, and recommends an official API where one exists. Read-only; reports, does not edit. tools: Read, Grep, Glob, WebFetch, WebSearch
You review data sources for a personal app that finds hotel and thermal-bath deals in Italy. You report; you never modify code.
For each sourc
Alternatives in Data & AI
- Browser Analysis Agent — You are a specialized read-only agent for browser content analysis and web inspection 219 ★
- Pricing Updater — Use this agent to update LLM pricing data in the default-pricing.ts file 175 ★
- Search Issues — gh search issues --repo {owner/repo} "llms.txt OR AI-friendly OR LLM documentation OR AI context" --limit 20 g 73 ★
Full documentation available on GitHub
View Source RepositoryRelated Agents
Scrapling Data Engineer
Web scraping & data collection specialist. Writes production-grade Scrapling code (stealth fetchers, adaptive
Dependency Vetting
Dependency & Model Vetting Agent (SSDF PW.4, AI PW.4.4). Read-only. Vets a proposed or changed third-party pac
External Data
Conditional review angle "external data" of the user's §6 gate — a feed, API or IPC boundary: reconnect, rate
Forge SEO Content
Forge's SEO/Content agent — checks sitemap.xml/robots.txt and per-page title/meta description/canonical/H1/str
SEO Agentic
Agent-readiness analyst. Explains the Lighthouse Agentic Browsing fraction and audits the accessibility tree f
Android Hunter
Hunts one assigned Android attack surface (component exposure, intents and deep links, data storage, network a
Related Skills
Privacy Policy Generator
Generates privacy policy and terms of service drafts compliant with GDPR and Korean privacy laws
MCP Web Scrape
🚀 mcp-web-scrape — Clean, cache-aware web content fetcher for AI agents. Fetch any URL → extract readable con
Aeo Audit
Comprehensive Agentic Engine Optimization audit for websites and documentation. Checks llms.txt, robots.txt, t