custom-plugin-data-engineer
π‘ Summary
This skill provides a suite of AI agents and skills tailored for data engineering tasks.
π― Target Audience
π€ AI Roast: βPowerful, but the setup might scare off the impatient.β
Risk: Medium. Review: shell/CLI command execution; outbound network access (SSRF, data egress); filesystem read/write scope and path traversal. Run with least privilege and audit before enabling in production.
π¦ Install Now Β· π€ Explore Agents Β· π Documentation Β· β Star this repo
What is this?
Data Engineer Assistant is a Claude Code plugin with 6 agents and 21 skills for data engineer development.
π Table of Contents
π Quick Start
Prerequisites
- Claude Code CLI v2.0.27+
- Active Claude subscription
Installation (Choose One)
# Step 1οΈβ£ Add the marketplace /plugin marketplace add pluginagentmarketplace/custom-plugin-data-engineer # Step 2οΈβ£ Install the plugin /plugin install data-engineer-development-assistant@pluginagentmarketplace-data-engineer # Step 3οΈβ£ Restart Claude Code # Close and reopen your terminal/IDE
# Clone the repository git clone https://github.com/pluginagentmarketplace/custom-plugin-data-engineer.git cd custom-plugin-data-engineer # Load locally /plugin load . # Restart Claude Code
β Verify Installation
After restart, you should see these agents:
data-engineer-development-assistant:03-devops-engineer
data-engineer-development-assistant:01-data-engineer
data-engineer-development-assistant:02-backend-developer
data-engineer-development-assistant:04-data-scientist
data-engineer-development-assistant:05-cloud-engineer
... and 1 more
β¨ Features
| Feature | Description | |---------|-------------| | π€ 6 Agents | Specialized AI agents for data engineer tasks | | π οΈ 21 Skills | Reusable capabilities with Golden Format | | β¨οΈ 7 Commands | Quick slash commands | | π SASMP v1.3.0 | Full protocol compliance |
π€ Agents
6 Specialized Agents
| # | Agent | Purpose | |---|-------|---------| | 1 | 03-devops-engineer | Master infrastructure automation, deployment pipelines, and | | 2 | 01-data-engineer | Master data pipelines, ETL systems, database design, and big | | 3 | 02-backend-developer | Build robust, scalable backend systems and APIs that power m | | 4 | 04-data-scientist | Transform data into actionable insights using machine learni | | 5 | 05-cloud-engineer | Design and manage cloud infrastructure and data platforms on | | 6 | 06-ml-ai-engineer | Master artificial intelligence, large language models, gener |
π οΈ Skills
Available Skills
| Skill | Description | Invoke |
|-------|-------------|--------|
| deep-learning | TensorFlow, PyTorch, CNNs, RNNs, transformers, neural networ | Skill("data-engineer-development-assistant:deep-learning") |
| big-data | Apache Spark, Hadoop, distributed computing, and large-scale | Skill("data-engineer-development-assistant:big-data") |
| api-development | REST APIs, GraphQL, FastAPI, data service design, and integr | Skill("data-engineer-development-assistant:api-development") |
| etl-tools | Apache Airflow, Spark, Kafka, Flink, dbt, and modern data tr | Skill("data-engineer-development-assistant:etl-tools") |
| cloud-platforms | AWS, Azure, GCP data platforms and cloud-native data solutio | Skill("data-engineer-development-assistant:cloud-platforms") |
| mlops | Model versioning, MLflow, experiment tracking, model registr | Skill("data-engineer-development-assistant:mlops") |
| data-warehousing | Snowflake, BigQuery, Redshift, Delta Lake, and data warehous | Skill("data-engineer-development-assistant:data-warehousing") |
| containerization | Docker, Kubernetes, and container orchestration for data app | Skill("data-engineer-development-assistant:containerization") |
| sql-databases | SQL query optimization, schema design, indexing, and relatio | Skill("data-engineer-development-assistant:sql-databases") |
| cicd-pipelines | Jenkins, GitHub Actions, GitLab CI, and automated data pipel | Skill("data-engineer-development-assistant:cicd-pipelines") |
| ... | +11 more | See skills/ directory |
β¨οΈ Commands
| Command | Description |
|---------|-------------|
| /choose-role | π― Choose Role - Pick Your Data Specialty |
| /project-ideas | π Project Ideas - Build Your Portfolio |
| /skill-deep-dive | π Skill Deep Dive - Master Any Technology |
| /assessment | π Assessment - Evaluate Your Knowledge |
| /roadmap-status | π Roadmap Status - Track Your Progress |
| /interview-prep | πΌ Interview Prep - Get Data Engineering Jobs |
| /start-learning | π Start Learning - Data Engineering Roadmap |
π Documentation
| Document | Description | |----------|-------------| | CHANGELOG.md | Version history | | CONTRIBUTING.md | How to contribute | | LICENSE | License information |
π Project Structure
custom-plugin-data-engineer/
βββ π .claude-plugin/
β βββ plugin.json
β βββ marketplace.json
βββ π agents/ # 6 agents
βββ π skills/ # 21 skills (Golden Format)
βββ π commands/ # 7 commands
βββ π hooks/
βββ π README.md
βββ π CHANGELOG.md
βββ π LICENSE
π Metadata
| Field | Value | |-------|-------| | Version | 2.0.0 | | Last Updated | 2025-12-29 | | Status | Production Ready | | SASMP | v1.3.0 | | Agents | 6 | | Skills | 21 | | Commands | 7 |
π€ Contributing
Contributions are welcome! Please read our Contributing Guide.
- Fork the repository
- Create your feature branch
- Follow the Golden Format for new skills
- Submit a pull request
β οΈ Security
Important: This repository contains third-party code and dependencies.
- β Always review code before using in production
- β Check dependencies for known vulnerabilities
- β Follow security best practices
- β Report security issues privately via Issues
π License
Copyright Β© 2025 Dr. Umit Kacar & Muhsin Elcicek
Custom License - See LICENSE for details.
π₯ Contributors
Made with β€οΈ for the Claude Code Community
Pros
- Comprehensive set of agents and skills.
- Supports various data engineering tasks.
- Easy installation and setup.
Cons
- Requires an active Claude subscription.
- Limited to Claude Code environment.
- May have a learning curve for new users.
Related Skills
spark-engineer
AβThis skill is like a Swiss Army knife for big dataβjust don't expect it to cut through all the noise.β
metabase
AβIt's the Swiss Army knife of business intelligence, but setting it up feels more like assembling IKEA furniture without the pictograms.β
superclaude
AβPowerful, but the setup might scare off the impatient.β
Disclaimer: This content is sourced from GitHub open source projects for display and rating purposes only.
Copyright belongs to the original author pluginagentmarketplace.
