Files
doc-exports/docs/dli/umn/dli_03_0077.html
Su, Xiaomeng 3a07c40729 dli_umn_20250212
Reviewed-by: Pruthi, Vineet <vineet.pruthi@t-systems.com>
Co-authored-by: Su, Xiaomeng <suxiaomeng1@huawei.com>
Co-committed-by: Su, Xiaomeng <suxiaomeng1@huawei.com>
2025-02-24 08:11:08 +00:00

888 B

Why Can't I Find the Specified Python Environment After Adding the Python Package?

I cannot find the specified Python environment after adding the Python 3 package.

Set spark.yarn.appMasterEnv.PYSPARK_PYTHON to python3 in the conf file to specify the Python 3 environment for the compute cluster.

New clusters use the Python 3 environment by default.