Skip to content

Port over search drop_old_data_daily dag

Ebernhardson requested to merge work/ebernhardson/drop-old-data-daily into main

This dag runs daily to clean up old data in hdfs. It allows a single patch to the repo to both add the new data being created and add the code that cleans it up as it ages. This comes from the wikimedia/discovery/analytics repo, ported from airflow v1.

Bug: T329870

Merge request reports