Skip to content

process all Wikipedias by default

Marco Fossati requested to merge section-alignment-all-wikis into main
  • set wp_codes default's to [], which translates into leaving the pyspark scripts default behaviors: process all Wikipedias
  • wp_codes is kept as a variable property that can be overridden
  • sensors now wait by default for the entire input snapshot partitions. Specific wiki partitions are instead specified only if wp_codes is overridden
  • simplify code, variable & DAG task names
  • update fixtures
Edited by Marco Fossati

Merge request reports