Hosted By
-
Kenten Danas
Lead Developer Advocate
Astronomer -
Viraj Parekh
Field CTO
Astronomer
In this webinar, we provide an overview of the major new features and significant updates included in the newly released Airflow 2.4. Working through a variety of use cases, this high-level recap addresses new data-driven scheduling capabilities that help users avoid monolithic DAGs.
The webinar focuses on a number of specific new features in Airflow 2.4, such as:
- Datasets and data-aware scheduling, which lets DAG authors create smaller and more self-contained DAGs
- Updates to dynamic task mapping
- A consolidated schedule parameter
- New operators and decorators
- And more!
All of the sample code shown in this webinar can be found in this repo.
Get Apache Airflow Certified
If you want to learn more about how to get started with Airflow, you can join the thousands of other data engineers who have received the Astronomer Certification for Apache Airflow Fundamentals. This exam assesses an understanding of the basics of the Airflow architecture and the ability to create simple data pipelines for scheduling and monitoring tasks.
Learn More About Certification
