Rankings

Data Pipeline Orchestration

The layer that decides what runs, when, and what happens when it fails: DAG schedulers, asset-aware orchestrators and declarative pipeline engines for data and ML workloads. Every entry here is judged on scheduling, backfills, partitions, lineage and recovery over datasets. Durable-execution engines for application workflows — Temporal, Inngest and the agent frameworks — solve an adjacent problem with no dataset or backfill model, and are ranked separately under Agent Orchestration Frameworks. Two of the seven below are now one company: Prefect announced it was acquiring Dagster Labs on 13 July 2026.