Move dump_to_hive jobs to spark3
This patch concerns two jobs:
- commons_structured_data_dump_to_hive_weekly
- wikidata_dump_to_hive_weekly
Patches:
- Update dags default_args to use spark3
- Rename files and dag_ids for consistency
- Add minimal test
How to register an account on GitLab. To prevent spam, new accounts are locked until approved by an admin or the approver bot. You can also file an unlock request to expedite access.
Support: mw:GitLab, how to host a project on GitLab, #wikimedia-gitlab on libera.chat, #GitLab on Phabricator.
This patch concerns two jobs:
Patches: