De Spark Expert — Data & AI agent for Claude Code
Expert Apache Spark developer for PySpark and Scala distributed data processing.
How to install De Spark Expert
Installs to ~/.claude/agents/baekenough-oh-my-customcode-de-spark-expert.md
mkdir -p ~/.claude/agents && curl -fsSL https://raw.githubusercontent.com/baekenough/oh-my-customcode/HEAD/.claude/agents/de-spark-expert.md -o ~/.claude/agents/baekenough-oh-my-customcode-de-spark-expert.md Restart Claude Code, or start a new session, for it to be picked up.
What De Spark Expert does
name: de-spark-expert description: Expert Apache Spark developer for PySpark and Scala distributed data processing. Use for Spark jobs (*.py, *.scala), spark-submit configs, Spark-related keywords, and large-scale data transformation. model: claude-sonnet-5 domain: data-engineering memory: local effort: high skills:
- spark-best-practices tools:
- Read
- Write
- Edit
- Grep
- Glob
- Bash permissionMode: bypassPermissions
You are an expert Apache Spark 4.x developer for per
Alternatives in Data & AI
- Gdpr Data Handling — Practical implementation guide for GDPR-compliant data processing, consent management, and privacy c... - wsho 31.9k ★
- Business & Technical Agent Personas — 76+ specialized agent personas across 13 categories including technical excellence, AI automation, finance, ma 196 ★
- PDF Debugger — Debug PDF processing issues — OCR failures, text extraction problems, AI misclassification, and renaming error 116 ★
Full documentation available on GitHub
View Source RepositoryRelated Agents
De Dbt Expert
Expert dbt developer for SQL modeling, testing, and documentation. Use for dbt model files (.sql in models/),
Rails Backend Expert
Use this agent when working on Ruby on Rails backend code, including models, controllers, services, jobs, data
Python Engineer
Use this agent when developing Python applications, APIs, data processing pipelines, automation scripts, or an
Engineering Data Engineer
Expert data engineer specializing in PySpark pipelines, Delta Lake, Databricks, medallion lakehouse architectu
Scene Prompt Smith
Use this agent when drafting kie.ai Nano Banana 2 image prompts for the scenes of a short video. It turns a sc
Data Platform Reviewer
Data-platform pre-implementation reviewer. Specialises in dbt model contracts, Spark / Airflow lineage, PII de
Related Skills
Jvm Rules
Always-on JVM-language standards. Apply when working with Java, Kotlin, or Scala-on-Spark code. Merged from Ef
Sparktutor
Interactive Apache Spark 4.1 learning environment — VS Code extension with Claude-powered tutoring
DSPy Multi Document Agents
An advanced distributed knowledge fabric for intelligent document processing, featuring multi-document agents,