检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
If hourly partitioning is required in the service scenario, use toYYYYMMDD (table field pt_d) and toYYYYMMDD (table field pt_h) as the joint partitioning key. toYYYYMMDD (table field pt_h) is an integer number of hours.
Configuring an Auto Scaling Rule Upgrading Master Node Specifications If Master nodes cannot meet service requirements, you can upgrade their specifications.
If HDFS Load Balance is enabled during file writing, the NameNode selects a DataNode (in the order of local node, local rack, and remote rack). If the I/O load of the selected node is heavy, the NameNode will choose another DataNode with lighter load.
Figure 2 RDD operation The data and operation model of RDD are quite different from those of Scala. val file = sc.textFile("hdfs://...") val errors = file.filter(_.contains("ERROR")) errors.cache() errors.count() The textFile operator reads log files from the HDFS and returns file
For details about how to use the client on a Master or Core node in the cluster, see Using an MRS Client on Nodes Inside a Cluster. For details about how to install the client outside the MRS cluster, see Using an MRS Client on Nodes Outside a Cluster.
For details about how to use the client on a Master or Core node in the cluster, see Using an MRS Client on Nodes Inside a Cluster. For details about how to install the client outside the MRS cluster, see Using an MRS Client on Nodes Outside a Cluster.
1 to 64 characters, including only letters, digits, underscores (_), and hyphens (-).
The capacity (including storage and computing capabilities) of an MRS cluster can be expanded by adding core or task nodes. Password requirement Keep the initial password for logging in to the master node properly because MRS does not save it.
Copy and run the command in the DetailCmd column in the command output as follows: show proc xxx; In the command output, check whether the value of LstFailedTime is NULL and whether the value of VersionCount is greater than the specified threshold (200 by default).
Only letters, digits, hyphens (-), and underscores (_) are allowed. Rule names must be unique in a node group. Default value N/A description No String Explanation Description about an auto scaling rule. Constraints N/A Value range It contains a maximum of 1024 characters.
If nanosecond (ns) time precision is enabled for the IoTDB on the server, the -tp ns parameter needs to be added when the client imports data with the nanosecond timestamp.
Default value: 8 8 (The value ranges from 0 to 200 and cannot exceed the maximum number of connections.) hive.metastore.connection.pool.minIdle Minimum number of idle threads in the connection pool.
Use sc.show_profiles() to display the analysis results or display the analysis results before the Driver exits. You can use sc.dump_profiles(path) to dump the results to a disk.
Set Agency Name, select Cloud service for Agency Type, and select Elastic Cloud Server (ECS) and Bare Metal Server (BMS) for Cloud Service to authorize ECS or BMS to invoke OBS. Set Validity Period to Unlimited and click OK.
Constraints N/A Value range The value can contain 1 to 64 characters, including only letters, digits, underscores (_), and hyphens (-).
Cloud Service: Select Elastic Cloud Server (ECS) and Bare Metal Server (BMS). Validity Period: Select Unlimited. On the displayed page, search for the OBS OperateAccess policy and select it. Click Next, click Show More, select Global services, and click OK.
Constraints N/A Value range The value can contain 1 to 64 characters, including only letters, digits, underscores (_), and hyphens (-).
For details, see Configuring the FlinkServer Job Restart Policy. fixed-delay: You need to configure Retry Times and Retry Interval (s). failure-rate: You need to configure Max Retry Times, Interval (min), and Retry Interval (s). none Click Submit in the upper left corner to submit
Server Shared Path: indicates the configured shared directory of the NAS server. (The shared path of the server cannot be set to the root directory, and the user group and owner group of the shared path must be nobody:nobody.)
Server Shared Path: indicates the configured shared directory of the NAS server. (The shared path of the server cannot be set to the root directory, and the user group and owner group of the shared path must be nobody:nobody.)
