检测到您已登录华为云国际站账号,为了您更好的体验,建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
Figure 2 RDD operation The data and operation model of RDD are quite different from those of Scala. val file = sc.textFile("hdfs://...") val errors = file.filter(_.contains("ERROR")) errors.cache() errors.count() The textFile operator reads log files from the HDFS and returns file
master node specifications are being scaled up. scaled_up_first: The standby master node specifications have been scaled up. scaled-up-success: The master node specifications have been scaled up.
Figure 11 RDD operation The data and operation model of RDD are quite different from those of Scala. val file = sc.textFile("hdfs://...") val errors = file.filter(_.contains("ERROR")) errors.cache() errors.count() The textFile operator reads log files from the HDFS and returns files
The Kerberos protocol adopts a client–server model and cryptographic algorithms such as AES (Advanced Encryption Standard). It provides mutual authentication, that is, both the client and the server can verify each other's identity.
On the active management node, run the following command to copy the client installation package to the core node: scp -p /tmp/MRS-client/MRS_Services_Client.tar IP address of the core node:/opt/client Log in to the core node as user root. Master nodes support Cloud-Init.
Upload the tar.gz package to any directory (the /opt directory of the Master node used as an example here).
Upload the tar.gz package to any directory (the /opt directory of the Master node used as an example here).
Log in to the server where the client is to be installed as the client installation user.
If you use the Linux environment for commissioning, prepare the Linux node where the cluster client is to be installed and obtain related configuration files. For details about how to use a client on the Master or Core nodes inside a cluster, see Installing a Client.
A "CLOSED" queue does not accept any new allocation request. active_state String This is inner state (self state) of queue.
state) of queue.
state) of queue.
state) of queue.
Figure 2 RDD operation The data and operation model of RDD are quite different from those of Scala. val file = sc.textFile("hdfs://...") val errors = file.filter(_.contains("ERROR")) errors.cache() errors.count() The textFile operator reads log files from the HDFS and returns file
Figure 2 RDD operation The data and operation model of RDD are quite different from those of Scala. val file = sc.textFile("hdfs://...") val errors = file.filter(_.contains("ERROR")) errors.cache() errors.count() The textFile operator reads log files from HDFS and returns file (as
Contains at least four types of the following: uppercase letters, lowercase letters, numbers, and special characters (~`!?,.;-_'(){}[]/<>@#$%^&*+|\=).
Constraints N/A Value range The value can contain 1 to 64 characters, including only letters, digits, underscores (_), and hyphens (-).
For how to fully update the original client of the active and standby master nodes, see Updating Client Configurations (Version 2.x or Earlier). For details about how to fully install the clients you set up, see Installing a Client (MRS 2.x or Earlier).
For details about how to use the client on a Master or Core node in the cluster, see Using an MRS Client on Nodes Inside a Cluster. For details about how to install the client outside the MRS cluster, see Using an MRS Client on Nodes Outside a Cluster.
If hourly partitioning is required in the service scenario, use toYYYYMMDD (table field pt_d) and toYYYYMMDD (table field pt_h) as the joint partitioning key. toYYYYMMDD (table field pt_h) is an integer number of hours.