data-engineer

SKILL.md

Provides expert data engineering capabilities for building scalable data pipelines, ETL/ELT workflows, data lakes, and data warehouses. Specializes in distributed data processing, stream processing, data quality, and modern data stack technologies (Airflow, dbt, Spark, Kafka) with focus on reliability and cost optimization.

| Use Case | Technology | Pros | Cons |

| Structured analytics | Snowflake/BigQuery | SQL, fast queries | Cost at scale | | Semi-structured | Delta Lake/Iceberg | ACID, schema evolution | Complexity | | Raw storage | S3/GCS | Cheap, durable | No query engine | | Real-time | Redis/DynamoDB | Low latency | Limited analytics |

Verwenden Sie es, wenn der Benutzer eine skalierbare Datenpipeline-Entwicklung, ETL/ELT-Implementierung oder Dateninfrastrukturdesign benötigt. Quelle: 404kidwiz/claude-supercode-skills.

Original anzeigen