检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
Run the vi /etc/ntp.conf command to edit the NTP client configuration file, add the IP addresses of the master node in the MRS cluster, and comment out the IP address of other servers. server master1_ip prefer server master2_ip Figure 2 Adding the master node IP addresses Run the
In the Nodes tab of the cluster details page, the nodes in the node group whose Node Type is Task are Task nodes. If only the NodeManager (Yarn) or Supervisor (Storm) role is deployed in a node group in addition to basic mandatory roles, this node group is a Task node group.
Logging In to an MRS Cluster Node This section describes how to remotely log in to an ECS in an MRS cluster using the remote login (VNC mode) function provided on the ECS management console or a key or password (SSH mode).
Support for Third-party JAR Packages on x86 and TaiShan Platforms Question How to enable Spark2x to support the third-party JAR packages (for example, custom UDF packages) if these packages have two versions (x86 and TaiShan)?
Support for Third-party JAR Packages on x86 and TaiShan Platforms Question How to enable Spark2x to support the third-party JAR packages (for example, custom UDF packages) if these packages have two versions (x86 and TaiShan)? Answer Use the hybrid solution.
Installing a Client (Versions Earlier Than 3.x) Scenario An MRS client is required. The MRS cluster client can be installed on the Master or Core node in the cluster or on a node outside the cluster.
Support for Third-party JAR Packages on x86 and TaiShan Platforms Question How to enable Spark2x to support the third-party JAR packages (for example, custom UDF packages) if these packages have two versions (x86 and TaiShan)? Answer Use the hybrid solution.
Support for Third-party JAR Packages on x86 and TaiShan Platforms Question How to enable Spark2x to support the third-party JAR packages (for example, custom UDF packages) if these packages have two versions (x86 and TaiShan)? Answer Use the hybrid solution.
Select the platform type based on the type of the node where the client is to be installed (select x86_64 for the x86 architecture and aarch64 for the Arm architecture) and click OK.
the server certificate is not authenticated.
Select the platform type based on the type of the node where the client is to be installed (select x86_64 for the x86 architecture and aarch64 for the Arm architecture) and click OK.
Select the platform type based on the type of the node where the client is to be installed (select x86_64 for the x86 architecture and aarch64 for the Arm architecture) and click OK.
TaiShan client: OpenJDK (1.8.0_242 version is supported). NOTE: For security purposes, the server supports only TLS V1.2 and later encryption protocols. IntelliJ IDEA installation and configuration It is the basic configuration for the development environment.
TaiShan client: OpenJDK (1.8.0_242 version is supported). NOTE: For security purposes, the server supports only TLS V1.2 and later encryption protocols. IntelliJ IDEA installation and configuration It is the basic configuration for the development environment.
Select the platform type based on the type of the node where the client is to be installed (select x86_64 for the x86 architecture and aarch64 for the Arm architecture) and click OK.
Selecting an API Type Currently, MRS provides two types (V1.1 and V2) of APIs for cloud services with customized specifications. Only part of V2 APIs is available and mainly used for submitting jobs and SQL statements.
Default value N/A cluster_id Yes String Explanation Cluster ID Constraints N/A Value range The value can contain 1 to 64 characters, including only letters, digits, underscores (_), and hyphens (-).
Configuration example (netcat tcp is used as the source, and logger is used as the sink).
Table 1 Reference list CPU Architecture OS Supported Version x86 computing Euler EulerOS 2.5 SUSE SUSE Linux Enterprise Server 12 SP4 (SUSE 12.4) Red Hat Red Hat-7.5-x86_64 (Red Hat 7.5) CentOS CentOS 7.6 Kunpeng computing (Arm) Euler EulerOS 2.8 CentOS CentOS 7.6 In addition, sufficient
The rules for matching ports and security protocols must be as follows: port 21007 matches the security mode (SASL_PLAINTEXT), and port 9092 matches the common mode (PLAINTEXT). monTime 0 (Disabled) Specifies the thread monitoring threshold.
