Workflow orchestration tools for data pipelines: Prefect, Dagster, and dbt. These tools handle scheduling, dependency resolution, retries, monitoring, and state management for production data pipelines.
| Tool | Paradigm | Best For | Learning Curve |
| Prefect | Flow-based | Pythonic workflows, quick prototypes, cloud-first | Moderate | | Dagster | Asset-based | Data asset lineage, reproducibility, type checking | Steeper | | dbt | SQL transformations | Analytics engineering, ELT, data warehouses | Low (SQL-focused) |
Оркестровка конвейеров и управление рабочими процессами с помощью Prefect, Dagster и dbt. Охватывает планирование, управление зависимостями, повторные попытки и шаблоны интеграции. Источник: legout/data-platform-agent-skills.