MapReduce服务 MRS-Spark任务由于内存不够或提交作业时未添加Jar包,作业卡住:问题现象

时间:2023-11-01 16:19:38

问题现象

使用Spark提交作业后,长期卡住不动。反复运行作业后报错,内容如下:

Exception in thread "main" org.apache.spark.SparkException: Job aborted due to stage failure: Aborting TaskSet 3.0 because task 0 (partition 0) cannot run anywhere due to node and executor blacklist. Blacklisting behavior can be configured via spark.blacklist.*. 
support.huaweicloud.com/trouble-mrs/mrs_03_0038.html