Updating Spark provider to 5.6 due to import error
Fixing imports for DAGs
File "/home/app/.local/lib/python3.11/site-packages/airflow/providers/apache/spark/operators/spark_submit.py", line 30, in <module>
from airflow.settings import WEB_COLORS
ImportError: cannot import name 'WEB_COLORS' from 'airflow.settings' (/home/app/.local/lib/python3.11/site-packages/airflow/settings.py)Import has been updated in providers-apache-spark/5.4.2rc1~14 .
Bug: T433388
Closes T433388