Skip to content

Update spark3 analytics for SparkSQLNoCLIDriver

Joal requested to merge spark3_sql into main

This patch hacks the analytics spark3 configuration to use the SparkSQLNoCLIDriver class instead of the default one, making it work in cluster mode. This is important until Spark3 gets installed on all hadoop workers and it can be run in client with Skein.

Bug: T306955

Merge request reports