Live with Astronomer

How to Save Money using Airflow’s asynchronous Azure operators

Watch On Demand

Hosted By

  • Kenten Danas Kenten Danas Lead Developer Advocate
  • Viraj Parekh Viraj Parekh Field CTO

This “Live with Astronomer” session shows how to implement the asynchronous Azure operators from the Astronomer Providers package to orchestrate a pipeline with long-running Azure Databricks and Azure Data Factory jobs. Using asynchronous Azure operators brings cost savings and better scalability when compared to traditional operators.

Questions covered in this session include: What is the Astronomer Providers package and how do I install it? How can I implement asynchronous operators in my existing DAGs? How do asynchronous operators help when orchestrating Azure Databricks and Azure Data Factory tasks?

Learn more about the Astronomer Providers and asynchronous Azure operators and access example DAGs on the Astronomer Registry.

Astronomer Apache Airflow Fundamentals Certification badge

Get Apache Airflow Certified

If you want to learn more about how to get started with Airflow, you can join the thousands of other data engineers who have received the Astronomer Certification for Apache Airflow Fundamentals. This exam assesses an understanding of the basics of the Airflow architecture and the ability to create simple data pipelines for scheduling and monitoring tasks.

Learn More About Certification