检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
Querying the exe Object List of Jobs (Deprecated) Function This API is used to query the exe object list of all jobs. This API is incompatible with Sahara. URI Format GET /v1.1/{project_id}/job-exes Parameter description Table 1 URI parameter Parameter Mandatory Description project_id
ALM-50401 Number of JobServer Jobs Waiting to Be Executed Exceeds the Threshold Alarm Description The system checks the number of jobs submitted to JobServer every 30 seconds. This alarm is generated when the number of jobs to be executed exceeds 800. Alarm Attributes Alarm ID Alarm
Class Cannot Be Found After Flume Submits Jobs to Spark Streaming Issue After Flume submits jobs to Spark Streaming, the class cannot be found. Symptom After the Spark Streaming code is packed into a JAR file and submitted to the cluster, an error message is displayed indicating that
A Large Number of Jobs Occupying Resources After Yarn Is Started in a Cluster Symptom In an MRS 2.x cluster or earlier, a large number of jobs are generated after Yarn is started, occupying computing resources of the cluster. Cause Analysis If the source IP address of the Any protocol
What Are the Differences Between the Client Mode and Cluster Mode of Spark Jobs? You need to understand the concept ApplicationMaster before understanding the essential differences between Yarn-client and Yarn-cluster. In Yarn, each application instance has an ApplicationMaster process
How Do I Forcibly Stop MapReduce Jobs Executed by Hive? Question How do I stop a MapReduce task manually if the task is suspended for a long time? Answer Log in to FusionInsight Manager. Choose Cluster > Name of the desired cluster > Services > Yarn. On the left pane, click ResourceManager
How Do I Forcibly Stop MapReduce Jobs Executed by Hive? Question How do I stop a MapReduce task manually if the task is suspended for a long time? Answer Log in to FusionInsight Manager. Choose Cluster > Name of the desired cluster > Services > Yarn. On the left pane, click ResourceManager
An Error Is Reported When a Yarn Client Command Is Used to Query Historical Jobs Symptom When a Yarn client command is executed to query historical jobs, the following error is reported and the process is terminated. Cause Analysis The memory allocated to the client is insufficient
What Can I Do If DataArts Studio Occasionally Fails to Schedule Spark Jobs? Symptom DataArtsStudio occasionally fails to schedule Spark jobs and the rescheduling also fails. The following error information is displayed: Caused by: org.apache.spark.SparkException: Application application
What Should I Do If Submitted Yarn Jobs Cannot Be Viewed on the Web UI? Question: Why a created Yarn job cannot be viewed when I log in to Manager as the admin user? Answer: The admin user is a user on the cluster management page. Check whether the user has the supergroup permission
How Do I View SQL Statements of Hive Jobs on the Yarn Web UI? Log in to FusionInsight Manager as a service user. Choose Cluster > Services > Yarn. Click ResourceManager(xxx,Active) next to ResourceManager WebUI. On the YARN web UI, click the ID of the job to be viewed. Click ApplicationMaster
What Should I Do If the Error Message "UnknownScannerExeception" Is Displayed for Spark Jobs? Symptom Spark jobs run slowly. Warning information is printed in run logs, and the error cause is UnknownScannerExeception. Solution Before running a Spark job, adjust the value of hbase.client.scanner.timeout.period
How Do I Configure Spark Jobs to Automatically Obtain More Resources During Execution? Question: How Do I Configure Spark Jobs to Automatically Obtain More Resources During Execution? Answer: Resources are a key factor that affects Spark execution efficiency. When multiple executors
What Should I Do If Jobs Fail to Be Submitted to YARN After JobGateway Starts for the First Time Question When JobGateway starts for the first time, jobs fail to be submitted to YARN, and no launcher-job ID is generated. On the YARN page, no launcher-job queue is displayed. Check
Why Can't I Submit Jobs on the Console After My IAM Account Is Assigned with MRS Permissions? Question: Why can't I submit jobs on the MRS console after my IAM account is assigned with the MRS ReadOnlyAccess and MRS FullAccess permissions? Answer: The account has the MRS ReadOnlyAccess
Why Do Reduce Tasks Fail to Run in Some OSs After the Native Task Feature is Enabled? Question After the Native Task feature is enabled, Reduce tasks fail to run in some OSs. Answer When -Dmapreduce.job.map.output.collector.class=org.apache.hadoop.mapred.nativetask.NativeMapOutputCollectorDelegator
Why Do Reduce Tasks Fail to Run in Some OSs After the Native Task Feature is Enabled? Question When -Dmapreduce.job.map.output.collector.class=org.apache.hadoop.mapred.nativetask.NativeMapOutputCollectorDelegator is executed to enable the Native Task feature during the running of
