A Beginner Guide for Learning Apache Airflow 2.X

Let’s suppose you want to create a system that runs periodically and performs some tasks on it. Now, that can be a very simple data clearing process to very advanced, like extracting, transforming, and loading data for a regular analytics report or re-training an ML model.

So we can use some manual techniques to perform all kinds of operations, which takes a lot of time, or we can automate our process and schedule tasks using Airflow.