T416478 Update commit SHA-1s for queries to remove filtered user agents

Andrew McAllister (WMDE)requested to merge
T416478-use-new-queries-without-filtered-user-agents into main

Note

Reviewers: Please see REVIEW_AIRFLOW_MRS.md for directions on what to check for.

Contributor checklist

  • I have written structure tests and generated fixtures for the included DAG(s) that will be merged into data-engineering/airflow-dags/tests/wmde and have ran the tests and code quality checks with Docker as outlined in the tests section of the Airflow DAGs project readme
  • I have tested the jobs for this DAG in my local database using queries generated with wmde/analytics/hql/gen_hql_test_scripts.py or by passing parameters to the production queries
  • All commit SHA-1s for HiveQL queries are appropriately defined for the query versions that should be run
    • I will update commit SHA-1s in the Airflow admin variables as well
  • I have tested the included DAGs using the process outlined in TEST_AIRFLOW_DAGS.md and the override_properties test variables provided for each DAG (see test screenshots below)
    • DAGs don't need to be tested as we're just updating commit SHAs
  • All tables that are needed by the included DAG jobs have been created and are accessible by the analytics-wmde Airflow user
    • This box being checked means that the total_filtered_user_agents columns for the production tables have been removed
  • All changes from the main branch have been rebased into this branch

Description

Bug: T416478

  • wd_action_api_metrics_monthly_dag
  • wd_rest_api_metrics_monthly
  • wd_dump_metrics_monthly
  • In wmde/analytics!57 we removed the total_filtered_user_agents column from the metrics queries and create table statements. This MR propagates the change via updating the commit SHA-1s for all related DAGs.
  • Review: Check that the query file changes correspond to the changed DAGs (they have same file names/paths)

Important

The checkbox above for checking that all tables have been made is now to indicate that the filtered_user_agents has been removed from the production wmde schema tables.

Test outputs

Please describe the outputs of the tests that were ran.

Destination tables summary
  • The query updates mean that the total_filtered_user_agents columns of all resulting tables will be removed
Edited by Andrew McAllister (WMDE)

Merge request reports