Skip to content

Add more parallelism to refine_to_hive_hourly_dag

Aqu requested to merge T369845_add_more_parallelism_of_refine into main
  • Set max_active_runs to 3 to expedite hourly dagrun completion in case of rerun.
  • Add more time before timing out tasks
  • Set writter algorithm to v2 to allow parallel writtings on the same hive table.

Merge request reports