Skip to content
GitLab
Projects Groups Snippets
  • /
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in
  • Airflow DAGs Airflow DAGs
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Custom issue tracker
    • Custom issue tracker
  • Merge requests 9
    • Merge requests 9
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Packages and registries
    • Packages and registries
    • Package Registry
    • Infrastructure Registry
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Repository
  • Activity
  • Graph
  • Jobs
  • Commits
Collapse sidebar
  • repos
  • data-engineering
  • Airflow DAGsAirflow DAGs
  • Merge requests
  • !227

Migrate edit druid job

  • Review changes

  • Download
  • Email patches
  • Plain diff
Merged Mforns requested to merge migrate-edit-druid-job into main Feb 06, 2023
  • Overview 10
  • Commits 13
  • Pipelines 5
  • Changes 9

Migrates the Druid-loading job for wmf.edit_hourly dataset. Modifies the HiveToDruidOperator to include some parameters needed for this job (map_memory). Also, some adjustments are needed to support snapshot-based partitioning.

Assignee
Assign to
Reviewers
Request review from
Time tracking
Source branch: migrate-edit-druid-job