T390891 WD Integration Team docs pageview metrics DAG
Contributor checklist
-
I have written tests for this DAG that will be merged into data-engineering/airflow-dags/tests/wmde -
I have locally ran the above tests and code quality checks as outlined in the tests section of the Airflow DAGs project readme -
I have tested the jobs for this DAG in my local database using the process defined in wmde/analytics/hql/airflow_jobs/wit_docs_pageview_metrics/_test_monthly -
I have tested the included DAGs in my local database using the process outlined in TEST_AIRFLOW_DAGS.md and the test variable files provided for each DAG - Not doing this at this time as I need to learn k8s based testing method
- This is a very standard DAG with a monthly sensor and one query ran
-
All Hive tables that are needed by the included DAG jobs have been created and are accessible by the analytics-wmdeAirflow userwmde.wit_docs_pageview_metrics_monthly
Description
- T390891: The included DAG calculates the total pageviews for a KPI for the Wikidata Integration Team. Specifically it runs jobs that calculate the pageviews for documentation pages maintained by the team as an indicator that their work is leading to interest in their efforts.
Test outputs
andrewtavis_wmde.wit_docs_pageview_metrics_monthly
| month | total_help_items_views | total_help_sitelinks_views | total_help_edit_summary_views | total_wikidata_wikidata_in_wmp_views | total_wikidata_how_to_use_data_on_wmp_views |
|---|---|---|---|---|---|
| 2025-04 | 5481 | 2011 | 67 | 274 | 768 |
Edited by Andrew McAllister (WMDE)