Pipeline — Data & AI agent for Claude Code
Builds a recurring Prefect 3 pipeline for an already-onboarded Data Basis dataset — download, clean, upload (dev+prod), dbt, and metadata refresh on a schedule.
How to install Pipeline
Installs to ~/.claude/agents/basedosdados-pipelines-pipeline.md
mkdir -p ~/.claude/agents && curl -fsSL https://raw.githubusercontent.com/basedosdados/pipelines/HEAD/.claude/agents/pipeline.md -o ~/.claude/agents/basedosdados-pipelines-pipeline.md Restart Claude Code, or start a new session, for it to be picked up.
What Pipeline does
name: pipeline description: Builds a recurring Prefect 3 pipeline for an already-onboarded Data Basis dataset — download, clean, upload (dev+prod), dbt, and metadata refresh on a schedule. tools:
- Read
- Write
- Edit
- Bash
- Glob
- Grep
Pipeline Agent
Author a recurring Prefect 3 pipeline that keeps an already-onboarded dataset up to date. Add this only after static onboarding is verified in dev.
Rules
- Follow
prefect-pipeline-conventionsfor structure, the flow
Alternatives in Data & AI
- Read Research For Nyquist Validation Data — cat "$phase_dir"/-RESEARCH.md 2>/dev/null node "$HOME/.claude/get-shit-done/bin/gsd-tools.cjs" roadmap get-pha 38.5k ★
- Harness Radar — Weekly movement briefing on the AI agent harness space — what climbed, what entered the radar, what died — fro 801 ★
- Presenter Agent — Creates presenter objects using SimpleDelegator for clean view formatting and display logic 652 ★
Full documentation available on GitHub
View Source RepositoryRelated Agents
Metadata
Registers or updates all metadata in the Data Basis backend — dataset, tables, columns, observation levels, co
Raw Data Downloader
Downloads raw data files for a Data Basis dataset from the source URL(s). Handles diverse download mechanisms
Replication Coder
Use this agent to port the original paper's analysis into the standard 4-notebook pipeline (01_data_download,
Docs Dev
Owns the dbdocs package — the click CLI plus the extract/site pipeline that turns dbt artifacts into a single-
Webship Workspace Agents
Use this agent to back up, clean up, or maintain AI agent definition repos inside ~/workspace/agents/ (e.g. de
Codemap Writer
Generate or refresh docs/CODEMAPS/ for the current repo. Use when the user runs /update-codemaps, when context
Related Skills
Onboarding Pipeline
Build a recurring Prefect 3 pipeline for an already-onboarded Data Basis dataset
Equip Silo Provider
Add a provider (claude, codex, grok, gemini, …) to an already-onboarded account silo with farm equip, completi
Jobs
Create, list, edit, or delete cron jobs. Triggers: create a job, add a job, new job, schedule a task, schedule