检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
Log in to the OBS management console, click Parallel File System, click the name of the OBS parallel file system where the Hive table resides, and view the value of Endpoint on the overview page.
OBS Path: Select the name of the created OBS parallel file system, find the book_score.txt file, select I confirm that the selected script is secure, and I understand the potential risks and accept the possible exceptions or impacts on the cluster, and click OK.
You can upload the files to OBS and import them from OBS to HDFS on the Files page of the MRS console. For details, see Importing and Exporting Data.
When importing data from a relational database to HDFS or OBS, you do not need to configure data conversion. Data is separated by commas (,) and saved to HDFS or OBS. When exporting data from HDFS or OBS to a relational database, you do not need to configure data conversion.
When importing data from a relational database to HDFS or OBS, you do not need to configure data conversion. Data is separated by commas (,) and saved to HDFS or OBS. When exporting data from HDFS or OBS to a relational database, you do not need to configure data conversion.
Reference For details about how to handle an expired OBS certificate, see Expired OBS Certificate in a Cluster. Parent topic: MRS Cluster Alarm Handling Reference
Reference For details about how to handle an expired OBS certificate, see Expired OBS Certificate in a Cluster. Parent topic: MRS Cluster Alarm Handling Reference
ALM-45179 Number of Failed OBS readFully API Calls Exceeds the Threshold ALM-45180 Number of Failed OBS read API Calls Exceeds the Threshold ALM-45181 Number of Failed OBS write API Calls Exceeds the Threshold ALM-45182 Number of Throttled OBS Operations Exceeds the Threshold ALM
Why Is the OBS Quick Deletion Directory Not Applied After Being Added to the Custom Hive Configuration? Hive Configuration Problems Parent topic: Using Hive
Cause Analysis When the load command is used to import data to the Hive table across file systems (for example, the original data is stored in the HDFS but the Hive table data is stored in the OBS), and the file length is greater than the threshold (32 MB by default).
Table 3 Big data component information Component Source Cluster Version Target Cluster Version (Example: MRS 1.9.2) Description HDFS/OBS (or other file storage systems) Hadoop 2.8.3 Hadoop 2.8.3 - Hive 1.2.1 2.3.3 Database for storing metadata: MySQL HBase 1.3.1 1.3.1 - Spark 2.2.2
Common Operation MRS Console FusionInsight Manager Changing subnets, adding security group rules, controlling OBS permissions, managing agencies, and synchronizing IAM users Supported Not supported Adding node groups, scaling out, scaling in, and upgrading specifications Supported
Why Do I Fail to Create a Table in the Specified Location on OBS After Logging to spark-beeline? Spark Shuffle Exception Handling Why Cannot Common Users Log In to the Spark Client When There Are Multiple Service Scenarios in Spark?
Cluster Management Failed to Reduce Task Nodes OBS Certificate in a Cluster Expired Replacing a Disk in an MRS Cluster (Applicable to 2.x and Earlier) Replacing a Disk in an MRS Cluster (Applicable to 3.x) Failed to Execute an MRS Backup Task Inconsistency Between df and du Command
OBS: indicates that backup files are stored in OBS.
OBS: indicates that backup files are stored in OBS.
OBS: indicates that backup files are stored in OBS.
If a message displays indicating that OBS server cannot be connected, repeat 3. Click Save. If a Loader job has integrated into a Loader link, editing the link parameters may affect Loader running. Deleting a Link On the Loader page, click Manage links.
Impact on the System Some hot data on the local disk is moved to OBS, affecting the read and write performance of the system. Possible Causes The local disk capacity configured for cold-hot separation on the ClickHouseServer node is too small.
As a result, OBS cannot be accessed. Possible Causes No ECS agency is bound to the cluster. An underlying interface of ECS is abnormal. Handling Procedure Check whether an agency is bound to the cluster. Log in to the MRS console.
