process all Wikipedias by default
- set
wp_codes
default's to[]
, which translates into leaving the pyspark scripts default behaviors: process all Wikipedias -
wp_codes
is kept as a variable property that can be overridden - sensors now wait by default for the entire input snapshot partitions.
Specific wiki partitions are instead specified only if
wp_codes
is overridden - simplify code, variable & DAG task names
- update fixtures
Edited by Marco Fossati