MapReduce服务 MRS-配置MRS客户端

时间:2023-11-01 16:25:03

配置MRS客户端

进入Spark客户端安装目录“/opt/client/Spark2x/spark/conf”,在spark-defaults.conf配置文件如下参数:

spark.pyspark.driver.python=/usr/bin/python3spark.yarn.dist.archives=hdfs://hacluster/user/python/python36.zip#Python
support.huaweicloud.com/usermanual-mrs/mrs_01_24555.html