Airflow Links

Read some about Luigi and how to do pipeline/workflow stuff in standard python leveraging a package like Luigi. Then use your understanding to look into how Airflow works.

• Luigi
  • https://luigi.readthedocs.io/en/stable/example_top_artists.html
• Link luigi to airflow
  • https://www.kdnuggets.com/2019/03/data-pipelines-luigi-airflow-everything-need-know.html

Then, read these airflow articles to help support what you're seeing about Airflow.

• Airflow Articles
  • Step by step: build a data pipeline with Airflow
  • Build Data Pipelines with Apache Airflow
  • Building a Production-Level ETL Pipeline Platform Using Apache Airflow
  • Airflow Tutorial
  • Airflow Template Repo