Workflow orchestration
Apache Airflow
Open-source orchestration for data engineering pipelines.
- Domain
- Workflow orchestration
- Type
- Product
- Maturity
- Core stack
Overview
Airflow defines data pipelines as Python code, then schedules, retries and monitors them. We use it for data pipelines where dependency order and backfill matter more than a visual canvas.
