检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
For how to fully update the original client of the active and standby master nodes, see Updating Client Configurations (Version 2.x or Earlier). For details about how to fully install the clients you set up, see Installing a Client (MRS 2.x or Earlier).
Set Agency Type to Cloud service and select Elastic Cloud Server (ECS) and Bare Metal Server (BMS) to authorize ECS or BMS to invoke OBS. Set Validity Period to Unlimited and click OK.
For details about how to use the client on a Master or Core node in the cluster, see Using an MRS Client on Nodes Inside a Cluster. For details about how to install the client outside the MRS cluster, see Using an MRS Client on Nodes Outside a Cluster.
For details about how to use the client on a Master or Core node in the cluster, see Using an MRS Client on Nodes Inside a Cluster. For details about how to install the client outside the MRS cluster, see Using an MRS Client on Nodes Outside a Cluster.
Figure 2 RDD operation The data and operation model of RDD are quite different from those of Scala. val file = sc.textFile("hdfs://...") val errors = file.filter(_.contains("ERROR")) errors.cache() errors.count() The textFile operator reads log files from the HDFS and returns file
Configuring an Auto Scaling Rule Upgrading Master Node Specifications If Master nodes cannot meet service requirements, you can upgrade their specifications.
If hourly partitioning is required in the service scenario, use toYYYYMMDD (table field pt_d) and toYYYYMMDD (table field pt_h) as the joint partitioning key. toYYYYMMDD (table field pt_h) is an integer number of hours.
If HDFS Load Balance is enabled during file writing, the NameNode selects a DataNode (in the order of local node, local rack, and remote rack). If the I/O load of the selected node is heavy, the NameNode will choose another DataNode with lighter load.
1 to 64 characters, including only letters, digits, underscores (_), and hyphens (-).
The capacity (including storage and computing capabilities) of an MRS cluster can be expanded by adding core or task nodes. Password requirement Keep the initial password for logging in to the master node properly because MRS does not save it.
All requests from Tablet Server and clients (such as Impala and Spark) interact with the Master through this port. webserver_port 8051 8051 Web UI port of the Kudu Master.
Default value: 8 8 (The value ranges from 0 to 200 and cannot exceed the maximum number of connections.) hive.metastore.connection.pool.minIdle Minimum number of idle threads in the connection pool.
Only letters, digits, hyphens (-), and underscores (_) are allowed. Rule names must be unique in a node group. Default value N/A description No String Explanation Description about an auto scaling rule. Constraints N/A Value range It contains a maximum of 1024 characters.
Copy and run the command in the DetailCmd column in the command output as follows: show proc xxx; In the command output, check whether the value of LstFailedTime is NULL and whether the value of VersionCount is greater than the specified threshold (200 by default).
Use sc.show_profiles() to display the analysis results or display the analysis results before the Driver exits. You can use sc.dump_profiles(path) to dump the results to a disk.
If nanosecond (ns) time precision is enabled for the IoTDB on the server, the -tp ns parameter needs to be added when the client imports data with the nanosecond timestamp.
Set Agency Name, select Cloud service for Agency Type, and select Elastic Cloud Server (ECS) and Bare Metal Server (BMS) for Cloud Service to authorize ECS or BMS to invoke OBS. Set Validity Period to Unlimited and click OK.
Constraints N/A Value range The value can contain 1 to 64 characters, including only letters, digits, underscores (_), and hyphens (-).
Cloud Service: Select Elastic Cloud Server (ECS) and Bare Metal Server (BMS). Validity Period: Select Unlimited. On the displayed page, search for the OBS OperateAccess policy and select it. Click Next, click Show More, select Global services, and click OK.
Constraints N/A Value range The value can contain 1 to 64 characters, including only letters, digits, underscores (_), and hyphens (-).
