Setup repo structure
- add CI config for linting / mypy / tests / publishing conda envs
-
research_datasets
module for the pipelines themselves -
research_transformations
module for shared code - example pyspark job that uses a udf from the transformations module
- update readme
Edited by Fabian Kaelin