Workflow orchestration tools for data pipelines: Prefect, Dagster, and dbt. These tools handle scheduling, dependency resolution, retries, monitoring, and state management for production data pipelines.
| Tool | Paradigm | Best For | Learning Curve |
| Prefect | Flow-based | Pythonic workflows, quick prototypes, cloud-first | Moderate | | Dagster | Asset-based | Data asset lineage, reproducibility, type checking | Steeper | | dbt | SQL transformations | Analytics engineering, ELT, data warehouses | Low (SQL-focused) |
Orchestration de pipeline et gestion des flux de travail avec Prefect, Dagster et dbt. Couvre la planification, la gestion des dépendances, les tentatives et les modèles d'intégration. Source : legout/data-platform-agent-skills.