Skip to content
GitLab
Projects Groups Snippets
  • /
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in
  • M MediaWiki Stream Enrichment
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Custom issue tracker
    • Custom issue tracker
  • Merge requests 2
    • Merge requests 2
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Packages and registries
    • Packages and registries
    • Package Registry
    • Infrastructure Registry
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Repository
  • Activity
  • Graph
  • Jobs
  • Commits
Collapse sidebar
  • repos
  • data-engineering
  • MediaWiki Stream Enrichment
  • Merge requests
  • !13

Quick demo of how to use RowTypeInfo to ensure better validation of the event data within the pipeline

  • Review changes

  • Download
  • Email patches
  • Plain diff
Merged DCausse requested to merge better-use-of-row-type-info into main Jul 26, 2022
  • Overview 11
  • Commits 13
  • Pipelines 4
  • Changes 16
  • use the proper RowTypeInfo at every step of the pipeline (tho require a cumbersome Tuple2 to carry the error or the event)
  • route errors to a side-output
  • some pom cleanups

The MR is not meant to be merged as-is but meant to be a quick demo of how to properly propagate the RowTypeInfo obtained from the wikimedia-eventutilities.

Assignee
Assign to
Reviewers
Request review from
Time tracking
Source branch: better-use-of-row-type-info