WEBINAR

Debugging your Airflow DAGs

Recorded On January 31, 2023

  • Tamara Fingerlin
  • Kenten Danas

This webinar provides an overview of how to easily and effectively debug your Airflow DAGs when an error inevitably occurs. We cover everything from setting up a local environment for iterative development, to debugging DAG and task issues, to identifying issues with your Airflow infrastructure.

Questions covered in this session include:

  • What do I do if my local AIrflow instance won’t start?
  • What is the easiest way to implement local testing for Airflow DAGs?
  • How do I find my task and scheduler logs, and what do I do if my logs aren’t showing up?
  • Where can I get additional help and how do I file an issue in Airflow if I encounter a bug?

All of the code shown in this webinar can be found in this repo. Additional resources mentioned include:

See More Resources

Introduction to Observability for Data Pipelines

2024 Apache Airflow®: Trends and Insights

Optimizing your Airflow Developer Experience: Exploring DAG Versioning and Backfills

Airflow best practices: debugging and testing

Try Astro for Free for 14 Days

Sign up with your business email and get up to $500 in free credits.

Get Started

Build, run, & observe your data workflows. All in one place.

Build, run, & observe
your data workflows.
All in one place.

Try Astro today and get up to $500 in free credits during your 14-day trial.