Merge requests · repos / data-engineering / Airflow DAGs

Update cassandra loading jar

!144 · created Sep 22, 2022 by Joal
- Merged
- Approved
updated Sep 22, 2022
Fix mediawiki_history_load DAG test

!145 · created Sep 22, 2022 by Joal
- Merged
- Approved
updated Sep 22, 2022
Run daily job to collect Wikidata special page access metric via graphite

!100 · created Jul 06, 2022 by Michael Große
- Merged
- 12
- Approved
updated Sep 22, 2022
Add jobs for geoeditors load, public monthly, and yearly.

!137 · created Sep 13, 2022 by Xcollazo
- Merged
- 40
- 1
- Approved
updated Sep 22, 2022
Fix cassandra load

!143 · created Sep 21, 2022 by NOkafor
- Merged
- 2
- Approved
updated Sep 21, 2022
Fix cassandra_load_hourly sensor

!142 · created Sep 20, 2022 by NOkafor
- Merged
- Approved
updated Sep 20, 2022
Hive to cassandra load

!134 · created Sep 02, 2022 by NOkafor
- Merged
- 104
- Approved
updated Sep 20, 2022
Update mediawiki_history_load SLA to 5 days

!133 · created Sep 01, 2022 by Joal
- Merged
- Approved
updated Sep 15, 2022
Airflow development improvements

!106 · created Jul 25, 2022 by Fabian Kaelin
- Merged
- 17
- Approved
updated Sep 15, 2022
Set production database and email for platform_eng/image-suggestions.

!126 · created Aug 23, 2022 by Xcollazo
- Merged
- Approved
updated Sep 09, 2022
Add wmf_raw.mediawiki_linktarget to analytics/mediawiki_history_load.

!135 · created Sep 06, 2022 by Xcollazo
- Merged
- 2
- 1
- Approved
updated Sep 08, 2022
add Structured Data alerts email to the image suggestions DAG

!131 · created Aug 31, 2022 by Marco Fossati
- Merged
- 3
- Approved
updated Sep 01, 2022
Fix temp_directory on analytics/mediawiki_history_dumps.

!128 · created Aug 26, 2022 by Xcollazo
- Merged
- 1
updated Aug 26, 2022
Add job for MediaWiki history dumps.

!127 · created Aug 26, 2022 by Xcollazo
- Merged
- 5
- Approved
updated Aug 26, 2022
Use instance specific HDFS caches.

!125 · created Aug 22, 2022 by Xcollazo
- Merged
- 2
- Approved
updated Aug 22, 2022
Declare platform_eng specilfic hdfs artifact cache directory

!118 · created Aug 16, 2022 by Ottomata
- Merged
- 2
- Approved
updated Aug 22, 2022
Bump driver memory to 12G to avoid OOMs on image-suggestion's 'all_suggestions' Spark job.

!124 · created Aug 19, 2022 by Xcollazo
updated Aug 19, 2022
Run research jobs in production Yarn queue.

!122 · created Aug 19, 2022 by Xcollazo
- Merged
- 1
- Approved
updated Aug 19, 2022
Pickup latest conda dev for platform_eng/image-suggestions.

!121 · created Aug 18, 2022 by Xcollazo
updated Aug 18, 2022
fix wikidata item page link SLA

!117 · created Aug 16, 2022 by Mforns
- Merged
- Approved
updated Aug 17, 2022

Admin message

Admin message