检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
Configuring the Baseline Parameters for MapReduce Jobs Scenario The performance optimization effect is verified by comparing actual values with the baseline data. Therefore, determining optimal job baseline is critical to performance optimization. When determining the job baseline
Changing the Password for the OMS Database Administrator You are advised to regularly change the password for the OMS database administrator to enhance system O&M security. Log in to the active management node as user root. To ensure smooth cluster running, you are not allowed to
Configuring Notification Rules for MRS Jobs Simple Message Notification (SMN) is a reliable and flexible large-scale message notification service. It enables you to efficiently send messages to various endpoints, such as email addresses and phone numbers. MRS uses SMN to offer a publish
RocksDB State Backend of Flink Jobs This topic is available for MRS 3.3.0 and later versions only. Flink Job RocksDB When RocksDB is enabled as the state backend for jobs, a large amount of state data causes poor read and write performance of RocksDB. You can perform the following
Viewing the Health Status of FlinkServer Jobs This topic is available for MRS 3.3.0 or later only. Job Health Status When a large number of Flink jobs are running in a cluster, the FlinkServer web UI provides the Flink job health management function to help you evaluate the health
Managing Oozie Jobs Using Hue Scenario Users can use the Hue web UI to query all jobs in an MRS cluster. Hue provides a UI for Oozie job management. The Hue UI is used to view and analyze data such as files and tables. Do not perform high-risk management operations such as deleting
Configuring the Baseline Parameters for MapReduce Jobs Scenario The performance optimization effect is verified by comparing actual values with the baseline data. Therefore, determining optimal job baseline is critical to performance optimization. When determining the job baseline
Configuring the Distributed Cache to Execute MapReduce Jobs Scenarios This section applies to MRS 3.x or later. Distributed caching is useful in the following scenarios: Rolling upgrade During the upgrade, applications must keep the text content (JAR file or configuration file) unchanged
Changing the Password for an OMS Database Access User This section describes how to regularly change the password for an OMS database access user to enhance system O&M security. Impact on the System The OMS service needs to be restarted for the new password to take effect. The service
Failed to Run Jobs Related to the sftp-connector Connector Symptom The jobs related to the sftp-connector connector fail to be executed and "Failed to obtain the SFTP stream" is displayed. xxx (Failed to send channel request.) Error "subsystem request failed on channel 0. Connection
DataArts Studio Failed to Schedule Spark Jobs Issue DataArts Studio fails to schedule jobs, and a message is displayed indicating that data in the /thriftserver/active_thriftserver directory cannot be read. Symptom DataArts Studio fails to schedule jobs, and the following error is
Configuring the Distributed Cache to Execute MapReduce Jobs Scenarios This section applies to MRS 3.x or later. Distributed caching is useful in the following scenarios: Rolling upgrade During the upgrade, applications must keep the text content (JAR file or configuration file) unchanged
Where Are the Execution Logs of Spark Jobs Stored? Logs of unfinished Spark jobs are stored in the /srv/BigData/hadoop/data1/nm/containerlogs/ directory on the Core node. Logs of finished Spark jobs are stored in the /tmp/logs/Username/logs directory of the HDFS. Parent topic: Job
ALM-12039 Active/Standby OMS Databases Not Synchronized Description The system checks the data synchronization status between the active and standby OMS Databases every 10 seconds. This alarm is generated when the synchronization status cannot be queried for 30 consecutive times or
ALM-12062 OMS Parameter Configurations Mismatch with the Cluster Scale Alarm Description The system checks whether the OMS parameter configurations match with the cluster scale at each top hour. If the OMS parameter configurations do not meet the cluster scale requirements, the system
Data Cannot Be Saved When Loader Jobs Are Configured Question When Internet Explorer 10 or 11 is used to access the Loader page and submit data, an error is reported. Answer Symptom After data is saved and submitted, an error similar to "Invalid query parameter jobgroup id. cause:
Quota for Submitting Flink Jobs to ZooKeeper Exceeds the Threshold Symptom The quota for submitting Flink jobs to ZooKeeper exceeds the threshold. Possible Causes The number of submitted jobs exceeds the maximum number of jobs that can be processed by the flinkznode node. By default
Enhancing the Joins of Large and Small Tables in Flink Jobs This section applies to MRS 3.3.0 or later. Joining Big and Small Tables There are big tables and small tables when you join two Flink streams. Small table data is broadcasted to every join task, and large table data is rebalanced
An Error Is Reported When Oozie Schedules HiveSQL Jobs Symptom In an MRS 3.x cluster, Oozie fails to schedule Hive jobs. The HiveSQL logs show that the scheduling task is executed successfully but the Yarn job fails. The error information is as follows: java.io.ioException:output.properties
What Types of Spark Jobs Can Be Submitted in a Cluster? Question: What Types of Spark Jobs Can Be Submitted in a Cluster? Answer: MRS clusters support Spark jobs submitted in Spark, Spark Script, or Spark SQL mode. Parent topic: Job Management
