Hosted By
-
Kenten Danas
Lead Developer Advocate
Astronomer -
Viraj Parekh
Field CTO
Astronomer
This “Live with Astronomer” session shows how to implement the asynchronous Azure operators from the Astronomer Providers package to orchestrate a pipeline with long-running Azure Databricks and Azure Data Factory jobs. Using asynchronous Azure operators brings cost savings and better scalability when compared to traditional operators.
Questions covered in this session include: What is the Astronomer Providers package and how do I install it? How can I implement asynchronous operators in my existing DAGs? How do asynchronous operators help when orchestrating Azure Databricks and Azure Data Factory tasks?
Learn more about the Astronomer Providers and asynchronous Azure operators and access example DAGs on the Astronomer Registry.
Get Apache Airflow Certified
If you want to learn more about how to get started with Airflow, you can join the thousands of other data engineers who have received the Astronomer Certification for Apache Airflow Fundamentals. This exam assesses an understanding of the basics of the Airflow architecture and the ability to create simple data pipelines for scheduling and monitoring tasks.
Learn More About Certification