检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
List of resolved issues in MRS 2.1.0.8: MRS Manager The problem that the ECS API traffic is limited when OBS is accessed through an agency has been solved. Multiple users can log in to MRS Manager at the same time. Full-link monitoring is supported.
If you cannot directly connect to the client node to upload files through the local network, upload the JAR file or source data to OBS, import the file to HDFS on the Files tab page of the MRS cluster, and run the hdfs dfs -get command on the HDFS client to download the file to the
Currently, you can use either of the following methods to fix the vulnerability: Installing the Patch on Existing Cluster Nodes Installing the Patch on New Nodes Prerequisites You have downloaded the patch tool package MRS_Log4j_Patch.tar.gz from the OBS path.
Full migration Create two links on CDM to connect HDFS of the source cluster and the HDFS or OBS file system of Huawei Cloud MRS. Create a full migration job on CDM, configure source and destination parameters, and start the job.
OBS Bucket Check Determine whether you need to select I confirm that I only need to view logs and data verification results on MgC Agent and do not need to upload them to OBS as required. Execution Command Decide how to execute Hive commands.
If you cannot directly connect to the client node to upload files through the local network, upload the JAR file or source data to OBS, import the file to HDFS on the Files tab page of the MRS cluster, and run the hdfs dfs -get command on the HDFS client to download the file to the
For details, see Interconnecting an MRS Cluster with OBS Using an IAM Agency. To bind an agency to an MRS cluster, you need to create an IAM agency with required permissions in advance. By default, the system generates an MRS_ECS_DEFAULT_AGENCY agency.
If you cannot directly access the client node to upload files through the local network, upload the JAR package or source data to OBS, import it to HDFS on the Files tab of the MRS console, and run the hdfs dfs -get command on the HDFS client to download it to the client node.
If the storage duration of a data record exceeds the value specified by the COLD_BOUNDARY parameter, the system automatically moves the data to cold storage (OBS) during the compaction process. Insert a data record to a table.
Non-service data can be stored in the OBS or other ECS nodes. The cluster nodes only run MRS cluster programs. Other client applications or user service programs are deployed on separate ECS nodes.
Please use the obs: schema. The cluster does not support file paths starting with s3a:// or s3n://. Use a file path supported by the cluster, such as obs://. Use a protocol that matches the cluster version. 400 12000087 Failed to get billing records. Failed to obtain CDR files.
OBS Bucket Check Determine whether you need to select I confirm that I only need to view logs and data verification results on MgC Agent and do not need to upload them to OBS as required. Create a task for the destination by referring to 11.b to 11.c.
Set this parameter to an OBS bucket path or a local VM path. OBS bucket path: Enter a script path. For example, enter the path of the public sample script provided by MRS. Example: s3a://bootstrap/presto/presto-install.sh.
Set this parameter to an OBS bucket path or a local VM path. OBS bucket path: Enter a script path manually. For example, enter the path of the public sample script provided by MRS. Example: s3a://bootstrap/presto/presto-install.sh.
-Dmapreduce.job.hdfs-servers If OBS is connected, but the server still uses HDFS, you need to explicitly use this parameter in the command line to specify the HDFS address. The format is hdfs://{NAMESERVICE}. Replace NAMESERVICE with the HDFS NameService name.
-Dmapreduce.job.hdfs-servers If OBS is connected, but the server still uses HDFS, you need to explicitly use this parameter in the command line to specify the HDFS address. The format is hdfs://{NAMESERVICE}. Replace NAMESERVICE with the HDFS NameService name.
-Dmapreduce.job.hdfs-servers If OBS is connected, but the server still uses HDFS, you need to explicitly use this parameter in the command line to specify the HDFS address. The format is hdfs://{NAMESERVICE}. Replace NAMESERVICE with the HDFS NameService name.
-Dmapreduce.job.hdfs-servers If OBS is connected, but the server still uses HDFS, you need to explicitly use this parameter in the command line to specify the HDFS address. The format is hdfs://{NAMESERVICE}. Replace NAMESERVICE with the HDFS NameService name.
Parameter Default Open Source Port Default Custom Port Port Description ranger.obs.service.rpc.address.port 26901 26901 The RPC listening port for the Guardian OBS client service. token.server.http-server.port 26900 26900 HTTP listening port of the Guardian service. token.server.rpc.address.port
If the Hive table is stored on OBS, you can use the URL policy within the Ranger policy. Set the URL to the complete path of the object on OBS. The read and write permissions are used together with the URL. URL policies are not involved in other scenarios.
