WEBINAR

Dynamic Task Mapping

Recorded On May 24, 2022

  • Kenten Danas
  • Viraj Parekh

Note: For a full-length in-depth webinar on dynamic tasks see: Dynamic Tasks in Airflow. You can find additional information in the Create dynamic Airflow tasks guide and Airflow: Dynamic Task Mapping academy module.

In this Live with Astronomer we look closely at updates to the dynamic task mapping feature released in Airflow 2.4. We’ll show a couple of new methods for mapping over multiple parameters, and discuss how to choose the best mapping method for your use case.

You can find all the needed resources in this Github repository.

Live with Astronomer is a biweekly series of short, real-time online sessions for data pipeline authors, hosted by Astronomer’s resident Airflow experts. Topics range from Airflow feature highlights to DAG authoring how-tos to interviews with the developers of Airflow, and every session includes an audience Q&A. It’s all designed to make sure you get the most out of your Airflow experience.

See More Resources

How to expertly organize your DAGs with task groups

Simplified DAG Authoring with New Airflow Features

Best Practices for Building Secure Data Pipelines with Apache Airflow®

Airflow 101: Essential Tips For Beginners - Aug 2022

Try Astro for Free for 14 Days

Sign up with your business email and get up to $500 in free credits.

Get Started

Build, run, & observe your data workflows. All in one place.

Build, run, & observe
your data workflows.
All in one place.

Try Astro today and get up to $500 in free credits during your 14-day trial.