Skip to content

Symlink for SPARK_HOME=/usr/lib/spark3

Xcollazo requested to merge add-spark3-link into main

/opt/conda-analytics/lib/python3.10/site-packages/pyspark seems rather ugly to be the SPARK_HOME that we expose.

This MR adds a symlink so that we can have SPARK_HOME=/usr/lib/spark3. This follows the pattern we have for spark2 (under /usr/lib/spark2).

Edited by Xcollazo

Merge request reports