4 Things To Consider When Deciding How to Run Airflow

Watch On Demand

Hosted By

  • Viraj Parekh Viraj Parekh Field CTO
  • Kevin Ruppel Kevin Ruppel Head of Commercial Field Engineering

This webinar provides an overview of several options to consider when running Airflow in production, including running Airflow yourself, choosing a managed infrastructure option like MWAA or GCC, or Astro. We cover everything you need to know to decide which option is best for you, whether you’ve been running Airflow in production for years or you’re just thinking about what the right Airflow strategy is for your team. Questions covered in this session include:

  • What are some of the day 2 operational questions when building a production Airflow system?
  • How do different methods of running Airflow handle CI/CD, code promotion, and other parts of the software development lifecycle?
  • Which Airflow configurations – like executor types and scheduler settings – should you consider based on your use case?
  • How can choosing the right Airflow setup improve developer productivity for data engineers, analysts, scientists, and other data practitioners?

Astronomer Apache Airflow Fundamentals Certification badge

Get Apache Airflow Certified

If you want to learn more about how to get started with Airflow, you can join the thousands of other data engineers who have received the Astronomer Certification for Apache Airflow Fundamentals. This exam assesses an understanding of the basics of the Airflow architecture and the ability to create simple data pipelines for scheduling and monitoring tasks.

Learn More About Certification