Merge requests · repos / data-engineering / Airflow DAGs

Add missing mediacount_load skein fixture

!310 · created Mar 21, 2023 by Joal
- CLOSED
- 1
updated Mar 21, 2023
Draft: Airflow Migrate mediacounts load Oozie job

!281 · created Mar 10, 2023 by Jennifer Ebe T326194_airflow_deb_creation_with_gitlab_ci
- CLOSED
- 0
updated Mar 10, 2023
Draft: Add druid load unique devices per domain daily dag

!271 · created Mar 08, 2023 by Mforns
- CLOSED
- 0
updated Mar 09, 2023
Create Mediacount_archive daily dag

!242 · created Feb 23, 2023 by Jennifer Ebe T326194_airflow_deb_creation_with_gitlab_ci
- CLOSED
- 29
updated Mar 09, 2023
Add multi-datacenter Dataset and make DAGs robust against datacenter switchovers

!243 · created Feb 23, 2023 by Mforns
- CLOSED
- 25
updated Mar 06, 2023
Draft: Add initial evaluation dag for search-platform

!218 · created Jan 24, 2023 by Ebernhardson
- CLOSED
- 17
updated Jan 26, 2023
Bump image-suggestions to 0.7.0.dev0.

!216 · created Jan 20, 2023 by auto-push-from-structured-data
- CLOSED
- 1
updated Jan 21, 2023
Bump image_suggestions to 0.6.0-v0.6.0.

!213 · created Jan 19, 2023 by auto-push-from-structured-data
- CLOSED
- 1
updated Jan 20, 2023
Migrate 4 druid jobs

!211 · created Jan 18, 2023 by Mforns add-datasets
- CLOSED
- 0
updated Jan 18, 2023
Migrate navigationtiming to druid

!210 · created Jan 17, 2023 by Mforns add-datasets
- CLOSED
- 0
updated Jan 18, 2023
Add datasets with get_sensor_for method

!208 · created Jan 16, 2023 by Mforns
- CLOSED
- 0
updated Jan 17, 2023
Draft: Add HiveToDruidOperator, DruidSegmentSensor and Dataset, plus migrate druid_load_navigationtiming_dag.

!206 · created Jan 14, 2023 by Mforns
- CLOSED
- 0
updated Jan 16, 2023
Upgrade Airflow Dags to airflow 2.3.2

!116 · created Aug 15, 2022 by Snwachukwu
- CLOSED
- 6
updated Jan 04, 2023
[wip] Creation of the Airflow deb with conda environment spec

!164 · created Sep 29, 2022 by Aqu airflow_dagupgrade
- CLOSED
- 2
updated Jan 04, 2023
Fix typos in the templates of HDSF usage weekly

!192 · created Dec 08, 2022 by Aqu
- CLOSED
- 0
updated Dec 10, 2022
[WIP] Spark3 assembly

!98 · created Jul 05, 2022 by Aqu
- CLOSED
- 0
updated Oct 10, 2022
Update job_properties structure and create_sensor

!160 · created Sep 28, 2022 by NOkafor
- CLOSED
- 0
updated Sep 28, 2022
Update cassandra monthly sensor

!151 · created Sep 26, 2022 by NOkafor
- CLOSED
- 15
updated Sep 28, 2022
move logging from info to debug to reduce log size

!120 · created Aug 17, 2022 by Mforns
- CLOSED
- 0
updated Sep 27, 2022
Fix cassandra load

!148 · created Sep 23, 2022 by NOkafor
- CLOSED
- 0
updated Sep 23, 2022