Airflow – Profiles, Jobs, and Resources for Python Developers

Apache Airflow is an open-source platform to programmatically author, schedule, and monitor workflows.

It is used to build complex data pipelines and automate a wide variety of data processing tasks.