Skip to content

Add metadata ingestion jobs

Milimetric requested to merge datahub-metadata-ingestion into main

A conda environment with the datahub CLI tool is packaged as tgz and uploaded to archiva (manually at this time).

Use the Skein operator to pass that environment to YARN along with configuration files needed to run datahub metadata ingestion.

The SimpleSkeinOperator is updated to automatically kinit if keytab and principal are passed.

Merge request reports