Debugging your Airflow DAGs

Watch On Demand

Hosted By

  • Tamara Fingerlin Tamara Fingerlin Developer Advocate
  • Kenten Danas Kenten Danas Lead Developer Advocate

This webinar provides an overview of how to easily and effectively debug your Airflow DAGs when an error inevitably occurs. We cover everything from setting up a local environment for iterative development, to debugging DAG and task issues, to identifying issues with your Airflow infrastructure.

Questions covered in this session include:

  • What do I do if my local AIrflow instance won’t start?
  • What is the easiest way to implement local testing for Airflow DAGs?
  • How do I find my task and scheduler logs, and what do I do if my logs aren’t showing up?
  • Where can I get additional help and how do I file an issue in Airflow if I encounter a bug?

All of the code shown in this webinar can be found in this repo. Additional resources mentioned include:

Astronomer Apache Airflow Fundamentals Certification badge

Get Apache Airflow Certified

If you want to learn more about how to get started with Airflow, you can join the thousands of other data engineers who have received the Astronomer Certification for Apache Airflow Fundamentals. This exam assesses an understanding of the basics of the Airflow architecture and the ability to create simple data pipelines for scheduling and monitoring tasks.

Learn More About Certification