Skip to content

Update spark configuration

Joal requested to merge update_dag_spark_conf into main

Change the global configuration for jobs to run in the production queue and to not use memory-overhead. Change per-job configuration to make jobs scale more easily by growing the number of maximum-executors available through dynamic allocation.

Merge request reports