The source project of this merge request has been removed.
Port image_suggestions DAG from datapipelines repo.
In this MR we:
- Create a new top level folder to hold DAGs for the new
platform_eng
Airflow instance. - Copy DAG code from https://gitlab.wikimedia.org/repos/generated-data-platform/datapipelines/-/commits/T296814-image-suggestions/
- Port the code so that it follows airflow-dags conventions and uses its operators.
- Make the DAG pull artifacts from the new repo https://gitlab.wikimedia.org/repos/generated-data-platform/image-suggestions
See https://phabricator.wikimedia.org/T311417 for context.