Workflow orchestration tools for data pipelines: Prefect, Dagster, and dbt. These tools handle scheduling, dependency resolution, retries, monitoring, and state management for production data pipelines.
| Tool | Paradigm | Best For | Learning Curve |
| Prefect | Flow-based | Pythonic workflows, quick prototypes, cloud-first | Moderate | | Dagster | Asset-based | Data asset lineage, reproducibility, type checking | Steeper | | dbt | SQL transformations | Analytics engineering, ELT, data warehouses | Low (SQL-focused) |
Pipeline-Orchestrierung und Workflow-Management mit Prefect, Dagster und dbt. Behandelt Planung, Abhängigkeitsmanagement, Wiederholungsversuche und Integrationsmuster. Quelle: legout/data-platform-agent-skills.