Skip to content

Allow spark3-submit as a valid spark executable

Ebernhardson requested to merge work/ebernhardson/allow-spark3-submit into main

apache-airflow-providers-apache-spark 4.0.0, used in the airflow 2.5.1 deployment, adds a new limitation on the set of allowed executable names for spark-submit. Our deployment uses /usr/bin/spark3-submit, add it to the list of acceptable executables.

Merge request reports