Skip to content

Upgrade airflow to new version 2.9.2

Stevemunene requested to merge airflow_version_2_9_2 into main

Deploying the newest airflow version to access new features and fix some CVE related issues. The features are: Displaying meaningful names for each dynamic task instance generated in the UI. Currently, it shows only an integer, the index of the dynamic task instance. e.g., for the Refine source sensor, we would get from 0 to sense_ mediawiki_reading_depth Allowing depth-first execution within a dynamic dag. Instead of waiting for all sensors to pass before beginning to launch all the ETL jobs, we can queue the ETL job as soon as its matching sensor instance is successful.

This patch also contains a new version of tests done by Antoine Quhen Bug: T365449

Merge request reports