What is Airflow?
Apache Airflow is an open-source orchestration software originally developed by AirBnb. It is currently considered one of the top projects in the Apache Foundation and is thé leading open-source tool used today for scheduling, orchestrating and monitoring workflows. Workflows – directed acyclical graphs or DAGs in Airflow – can be anything from ELT to ELT jobs, starting and stopping clusters, sending alerts and/or refreshing data-warehouses or tabular models. Airflow is 100% scripted using Python code.
Want to get started?
Airflow is regularly implemented by element61 as it's flexible, easy-to-script and easy to host on e.g. Azure. Contact us if you want to get started
Want to know more?
- Read our insights on Azure Data Factory & Airflow: mutually exclusive or complementary?