Add mediawiki_content_history reconciliation app.

Gmodenarequested to merge
gmodena/mediawiki-event-enrichment:dumps-reconciliation into main

This MR introduces the following changes:

  • Adds a new enrichment application for the mediawiki_content_history reconciliation stream.
  • Refactors page_content_change and the integration testing suite to support multiple applications under the mediawiki-event-enrichment module.

Refactoring

I followed the functional style used in page_content_change while moving common logic into dedicated modules.

Currently, content_history expects page_change events and reuses page_content_change logic for content enrichment. This may change if content_history adopts ad-hoc event schemas other than mediawiki/page/change. For now it's consistent with the stream declaration in EventStreamConfig.

WIP

  • when either a redirect or content request fails, the event should be discarded (forwarded to the error topic).
  • add tests to cover error scenarios (e.g. a request fails)
  • enrichment should be performed on the mediawiki.content_history.reconcile event schema (e.g. resolve TODOs).
  • ensure naming consistency

cc / @xcollazo @tchin

Bug: T368787

Edited by Gmodena

Merge request reports