Files
doc-exports/docs/dli/umn/dli_03_0077.html
Su, Xiaomeng 12dd64efc7 dli_umn_20240430
Reviewed-by: Pruthi, Vineet <vineet.pruthi@t-systems.com>
Co-authored-by: Su, Xiaomeng <suxiaomeng1@huawei.com>
Co-committed-by: Su, Xiaomeng <suxiaomeng1@huawei.com>
2024-05-15 11:56:22 +00:00

1012 B

Why Can't I Find the Specified Python Environment After Adding the Python Package?

I cannot find the specified Python environment after adding the Python 3 package.

Set spark.yarn.appMasterEnv.PYSPARK_PYTHON to python3 in the conf file to specify the Python 3 environment for the compute cluster.

New clusters use the Python 3 environment by default.