Apache Spark, Hadoop, distributed computing, and large-scale data processing for petabyte-scale workloads
SKILL.md
Production-grade big data processing with Apache Spark, distributed systems patterns, and petabyte-scale data engineering.
| Apache Spark | Distributed processing | 3.5+ | | Delta Lake | ACID transactions | 3.0+ | | Apache Iceberg | Table format | 1.4+ | | Apache Flink | Stream processing | 1.18+ | | Databricks | Managed Spark platform | Latest | | AWS EMR | Managed Hadoop/Spark | 7.0+ | | Trino | Interactive queries | 400+ | | dbt | Transform layer | 1.7+ |
| Issue | Symptoms | Root Cause | Fix |
Apache Spark, Hadoop, distributed computing, and large-scale data processing for petabyte-scale workloads Source: pluginagentmarketplace/custom-plugin-data-engineer.
Facts (cite-ready)
Stable fields and commands for AI/search citations.
- Install command
npx skills add https://github.com/pluginagentmarketplace/custom-plugin-data-engineer --skill big-data- Category
- {}Data Analysis
- Verified
- ✓
- First Seen
- 2026-02-01
- Updated
- 2026-02-18
Quick answers
What is big-data?
Apache Spark, Hadoop, distributed computing, and large-scale data processing for petabyte-scale workloads Source: pluginagentmarketplace/custom-plugin-data-engineer.
How do I install big-data?
Open your terminal or command line tool (Terminal, iTerm, Windows Terminal, etc.) Copy and run this command: npx skills add https://github.com/pluginagentmarketplace/custom-plugin-data-engineer --skill big-data Once installed, the skill will be automatically configured in your AI coding environment and ready to use in Claude Code or Cursor
Where is the source repository?
https://github.com/pluginagentmarketplace/custom-plugin-data-engineer
Details
- Category
- {}Data Analysis
- Source
- skills.sh
- First Seen
- 2026-02-01