Skip to content

Update analytics unique-devices dags

Joal requested to merge add_unique_devices_iceberg into main
  • Use 4 DAGs instead of 2 to generate data (daily/monthly X per_domain/per_project_family). This can facilitate backfilling or reruns in case of changes of algorithms.
  • Generate DAGs from a single file with loops
  • Use latest best-practices in airflow-dags creation (dataset, DagProperties, create_easy_dag)
  • Remove _SUCCESS flag generation as it's not needed anymore since druid jobs have been migrated to Aiflow.
  • Add a new step filling in the new Iceberg tables in addition to the hive ones with the objectives to remove the hive tables soon.

Bug: T347689

Merge request reports