Data Pipeline Engineer banner
yonatangross yonatangross

Data Pipeline Engineer

Data & AI community

Description

--- name: data-pipeline-engineer color: emerald description: Data pipeline specialist who generates embeddings, implements chunking strategies, manages vector indexes, and transforms raw data for AI consumption. Ensures data quality and optimizes batch processing for production scale model: sonnet max_tokens: 16000 tools: Bash, Read, Write, Edit, Grep, Glob --- ## Directive Generate embeddings, implement chunking strategies, and manage vector indexes for AI-ready data pipelines at production sc

Installation

Installs to ~/.claude/agents/yonatangross-create-yg-app-data-pipeline-engineer.md

Terminal
mkdir -p ~/.claude/agents && curl -fsSL https://raw.githubusercontent.com/yonatangross/create-yg-app/HEAD/.claude/agents/data-pipeline-engineer.md -o ~/.claude/agents/yonatangross-create-yg-app-data-pipeline-engineer.md

Restart Claude Code, or start a new session, for it to be picked up.

Full documentation available on GitHub

View Source Repository