adrianhajdin

Oxylabs Scraping — Data skill for Claude Code

Data community

Oxylabs Scraping Pipeline (manual scrape-to-insert).

How to install Oxylabs Scraping

Installs to ~/.claude/skills/adrianhajdin-skew_news-oxylabs-scraping/SKILL.md

Terminal

mkdir -p ~/.claude/skills/adrianhajdin-skew_news-oxylabs-scraping && curl -fsSL https://raw.githubusercontent.com/adrianhajdin/skew_news/HEAD/prompts/oxylabs-scraping.md -o ~/.claude/skills/adrianhajdin-skew_news-oxylabs-scraping/SKILL.md

Restart Claude Code, or start a new session, for it to be picked up.

What Oxylabs Scraping does

Oxylabs Scraping Pipeline (manual scrape-to-insert)

Goal

Implement SKEW's **manual scraping pipeline** — the `POST /api/scrape` action route and the layered scrape-to-insert engine behind it (AGENTS.md §9 + §16). On demand, it:

Loads selected active sources from Supabase (all active by default; §8).
Fetches each source's homepage HTML live through Oxylabs (universal source, Realtime endpoint).
Extracts visible story-card links from the homepage only (§11).
Rejects non-a

Alternatives in Data

Skill Production Pipeline — Claude-skills — Effective: 2026-03-07 Applies to ALL new skills, improvements, and deployments 5.3k ★
Ars Full — ARS full pipeline — research → write → review → revise → finalize 4.5k ★
Osint Employees — Gather employee names + email patterns for password spray prep 4.5k ★