Data engineering best practices: medallion architecture, dataset lifecycle, partitioning, file sizing, schema evolution, and append/overwrite/merge patterns across Polars, PyArrow, DuckDB, Delta Lake, and Iceberg. Use when designing production data pipelines or reviewing data platform decisions.
Quickly install data-engineering-best-practices AI skill to your development environment via command line
Source: legout/data-platform-agent-skills.
Use this skill for production architecture and standards decisions: storage layout, lifecycle, incremental semantics, schema evolution, quality checks, and cost/performance tradeoffs.
Do not skip Silver validation for convenience; silent quality drift is costly.
| Append | strictly new immutable events | simplest, cheapest | | Partition overwrite | deterministic reprocessing for date/key slice | safe for backfills | | Merge/Upsert | corrections/late updates/deletes | needs key + conflict semantics |
Data engineering best practices: medallion architecture, dataset lifecycle, partitioning, file sizing, schema evolution, and append/overwrite/merge patterns across Polars, PyArrow, DuckDB, Delta Lake, and Iceberg. Use when designing production data pipelines or reviewing data platform decisions. Source: legout/data-platform-agent-skills.
Stable fields and commands for AI/search citations.
npx skills add https://github.com/legout/data-platform-agent-skills --skill data-engineering-best-practicesData engineering best practices: medallion architecture, dataset lifecycle, partitioning, file sizing, schema evolution, and append/overwrite/merge patterns across Polars, PyArrow, DuckDB, Delta Lake, and Iceberg. Use when designing production data pipelines or reviewing data platform decisions. Source: legout/data-platform-agent-skills.
Open your terminal or command line tool (Terminal, iTerm, Windows Terminal, etc.) Copy and run this command: npx skills add https://github.com/legout/data-platform-agent-skills --skill data-engineering-best-practices Once installed, the skill will be automatically configured in your AI coding environment and ready to use in Claude Code, Cursor, or OpenClaw
https://github.com/legout/data-platform-agent-skills