Live with Astronomer

Simplified DAG authoring with the Astro SDK

Watch On Demand

Hosted By

  • Daniel Imberman Daniel Imberman Strategy Engineer
  • Kenten Danas Kenten Danas Lead Developer Advocate

This “Live with Astronomer” session covers the Astro SDK, an open-source, revolutionary data transfer system that empowers Data Engineers, Data Scientists, and Business Analysts to create Airflow DAGs with code that prioritizes data movement over system configuration.

Topics covered in this session include:

  • How to use the Astro SDK in your Airflow environment.
  • How to use the @load_file decorator to load data from supported file systems without system-specific code.
  • How to use the @dataframe and @transform decorators to easily load your data and run Python or SQL transformations without boilerplate Airflow code.
  • How the dag.test() function can help you test your Astro SDK code.
  • How the Astro SDK can be used in unit testing.

All code shown in this session can be found in this repo. Learn more about the Astro SDK in the official repo, and with this step-by-step tutorial.

Astronomer Apache Airflow Fundamentals Certification badge

Get Apache Airflow Certified

If you want to learn more about how to get started with Airflow, you can join the thousands of other data engineers who have received the Astronomer Certification for Apache Airflow Fundamentals. This exam assesses an understanding of the basics of the Airflow architecture and the ability to create simple data pipelines for scheduling and monitoring tasks.

Learn More About Certification