Skip to content

Pin datahub API client version

Brouberol requested to merge pin-datahub-version into main

We've seen some tracebacks indicating that the datahub API client and server version were misaligned:

datahub.configuration.common.OperationalError: ('Unable to emit metadata to DataHub GMS, likely because the server version is too old relative to the client: Failed to validate record with class com.linkedin.datajob.DataJobInfo: ERROR :: /env :: unrecognized field found but not allowed\n', {'exceptionClass': 'com.linkedin.restli.server.RestLiServiceException', 'message': 'Failed to validate record with class com.linkedin.datajob.DataJobInfo: ERROR :: /env :: unrecognized field found but not allowed\n', 'status': 422})

See https://airflow-test-k8s.wikimedia.org/dags/addition/grid?dag_run_id=manual__2024-10-02T12%3A17%3A51.677313%2B00%3A00&num_runs=5&tab=logs&task_id=add_one_and_two

Signed-off-by: Balthazar Rouberol brouberol@wikimedia.org

Merge request reports