检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
Enhancing the Joins of Large and Small Tables in Flink Jobs This topic is available for MRS 3.3.0 or later only. Joining Big and Small Tables There are big tables and small tables when you join two Flink streams. Small table data is broadcasted to every join task, and large table
Data Cannot Be Saved When Loader Jobs Are Configured Question When Internet Explorer 10 or 11 is used to access the Loader page and submit data, an error is reported. Answer Symptom After data is saved and submitted, an error similar to "Invalid query parameter jobgroup id. cause:
ALM-12039 Active/Standby OMS Databases Not Synchronized Description The system checks the data synchronization status between the active and standby OMS Databases every 10 seconds. This alarm is generated when the synchronization status cannot be queried for 30 consecutive times or
ALM-12062 OMS Parameter Configurations Mismatch with the Cluster Scale Description The system checks whether the OMS parameter configurations match with the cluster scale at each top hour. If the OMS parameter configurations do not meet the cluster scale requirements, the system generates
An Error Is Reported When Oozie Schedules HiveSQL Jobs Symptom In an MRS 3.x cluster, Oozie fails to schedule Hive jobs. The HiveSQL logs show that the scheduling task is executed successfully but the Yarn job fails. The error information is as follows: java.io.ioException:output.properties
What Types of Spark Jobs Can Be Submitted in a Cluster? Question: What Types of Spark Jobs Can Be Submitted in a Cluster? Answer: MRS clusters support Spark jobs submitted in Spark, Spark Script, or Spark SQL mode. Parent topic: Job Management
Querying the exe Object List of Jobs (Deprecated) Function This API is used to query the exe object list of all jobs. This API is incompatible with Sahara. URI Format GET /v1.1/{project_id}/job-exes Parameter description Table 1 URI parameter Parameter Mandatory Description project_id
ALM-50401 Number of JobServer Jobs Waiting to Be Executed Exceeds the Threshold Alarm Description The system checks the number of jobs submitted to JobServer every 30 seconds. This alarm is generated when the number of jobs to be executed exceeds 800. Alarm Attributes Alarm ID Alarm
Class Cannot Be Found After Flume Submits Jobs to Spark Streaming Issue After Flume submits jobs to Spark Streaming, the class cannot be found. Symptom After the Spark Streaming code is packed into a JAR file and submitted to the cluster, an error message is displayed indicating that
A Large Number of Jobs Occupying Resources After Yarn Is Started in a Cluster Symptom In an MRS 2.x cluster or earlier, a large number of jobs are generated after Yarn is started, occupying computing resources of the cluster. Cause Analysis If the source IP address of the Any protocol
What Are the Differences Between the Client Mode and Cluster Mode of Spark Jobs? You need to understand the concept ApplicationMaster before understanding the essential differences between Yarn-client and Yarn-cluster. In Yarn, each application instance has an ApplicationMaster process
How Do I Forcibly Stop MapReduce Jobs Executed by Hive? Question How do I stop a MapReduce task manually if the task is suspended for a long time? Answer Log in to FusionInsight Manager. Choose Cluster > Name of the desired cluster > Services > Yarn. On the left pane, click ResourceManager
How Do I Forcibly Stop MapReduce Jobs Executed by Hive? Question How do I stop a MapReduce task manually if the task is suspended for a long time? Answer Log in to FusionInsight Manager. Choose Cluster > Name of the desired cluster > Services > Yarn. On the left pane, click ResourceManager
An Error Is Reported When a Yarn Client Command Is Used to Query Historical Jobs Symptom When a Yarn client command is executed to query historical jobs, the following error is reported and the process is terminated. Cause Analysis The memory allocated to the client is insufficient
What Can I Do If DataArts Studio Occasionally Fails to Schedule Spark Jobs? Symptom DataArtsStudio occasionally fails to schedule Spark jobs and the rescheduling also fails. The following error information is displayed: Caused by: org.apache.spark.SparkException: Application application
What Should I Do If Submitted Yarn Jobs Cannot Be Viewed on the Web UI? Question: Why a created Yarn job cannot be viewed when I log in to Manager as the admin user? Answer: The admin user is a user on the cluster management page. Check whether the user has the supergroup permission
How Do I View SQL Statements of Hive Jobs on the Yarn Web UI? Log in to FusionInsight Manager as a service user. Choose Cluster > Services > Yarn. Click ResourceManager(xxx,Active) next to ResourceManager WebUI. On the YARN web UI, click the ID of the job to be viewed. Click ApplicationMaster
What Should I Do If the Error Message "UnknownScannerExeception" Is Displayed for Spark Jobs? Symptom Spark jobs run slowly. Warning information is printed in run logs, and the error cause is UnknownScannerExeception. Solution Before running a Spark job, adjust the value of hbase.client.scanner.timeout.period
How Do I Configure Spark Jobs to Automatically Obtain More Resources During Execution? Question: How Do I Configure Spark Jobs to Automatically Obtain More Resources During Execution? Answer: Resources are a key factor that affects Spark execution efficiency. When multiple executors
Why Can't I Submit Jobs on the Console After My IAM Account Is Assigned with MRS Permissions? Question: Why can't I submit jobs on the MRS console after my IAM account is assigned with the MRS ReadOnlyAccess and MRS FullAccess permissions? Answer: The account has the MRS ReadOnlyAccess
