检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
Set this parameter to an OBS bucket path or a local VM path. OBS bucket path: Enter a script path, for example, enter the path of the public sample script provided by MRS. Example: obs://bootstrap/presto/presto-install.sh.
Why Do I Fail to Create a Table in the Specified Location on OBS After Logging to spark-beeline? Spark Shuffle Exception Handling Parent topic: Using Spark2x (for MRS 3.x or Later)
As a result, OBS cannot be accessed. Possible Causes The IAM service is abnormal. Handling Procedure Collect fault information. On FusionInsight Manager, choose O&M. In the navigation pane on the left, choose Log > Download.
Impact on the System If the average RPC processing time of the Guardian TokenServer instance exceeds the threshold, service access to OBS may slow down or even OBS cannot be accessed. Possible Causes The alarm threshold is improperly configured.
Impact on the System If the average RPC queuing time of the Guardian TokenServer instance exceeds the threshold, service access to OBS may slow down or even OBS cannot be accessed. Possible Causes The alarm threshold is improperly configured.
Script Path obs://mrs-samples/test.sh Script path. The value can be an OBS file system path or a local VM path. An OBS file system path must start with obs:// and end with .sh, for example, obs://mrs-samples/xxx.sh. A local VM path must start with a slash (/) and end with .sh.
As a result, OBS cannot be accessed. Possible Causes An underlying interface of ECS is abnormal. Handling Procedure Collect fault information. On FusionInsight Manager, choose O&M. In the navigation pane on the left, choose Log > Download.
Notes and Constraints If the migration destination is an OBS bucket, DistCp does not support incremental migration because OBS does not support snapshots. You need to learn about the customer's services and communicate with the customer to determine the migration time window.
Log in to the OBS management console, click Parallel File System, click the name of the OBS parallel file system where the Hive table resides, and view the value of Endpoint on the overview page.
OBS Path: Select the name of the created OBS parallel file system, find the book_score.txt file, select I confirm that the selected script is secure, and I understand the potential risks and accept the possible exceptions or impacts on the cluster, and click OK.
When importing data from a relational database to HDFS or OBS, you do not need to configure data conversion. Data is separated by commas (,) and saved to HDFS or OBS. When exporting data from HDFS or OBS to a relational database, you do not need to configure data conversion.
Reference For details about how to handle an expired OBS certificate, see Expired OBS Certificate in a Cluster. Parent Topic: MRS Cluster Alarm Handling Reference
Reference For details about how to handle an expired OBS certificate, see Expired OBS Certificate in a Cluster. Parent Topic: MRS Cluster Alarm Handling Reference
When importing data from a relational database to HDFS or OBS, you do not need to configure data conversion. Data is separated by commas (,) and saved to HDFS or OBS. When exporting data from HDFS or OBS to a relational database, you do not need to configure data conversion.
ALM-45179 Number of Failed OBS readFully API Calls Exceeds the Threshold ALM-45180 Number of Failed OBS read API Calls Exceeds the Threshold ALM-45181 Number of Failed OBS write API Calls Exceeds the Threshold ALM-45182 Number of Throttled OBS Operations Exceeds the Threshold ALM
Table 3 Big data component information Component Source Cluster Version Target Cluster Version (Example: MRS 1.9.2) Description HDFS/OBS (or other file storage systems) Hadoop 2.8.3 Hadoop 2.8.3 - Hive 1.2.1 2.3.3 Database for storing metadata: MySQL HBase 1.3.1 1.3.1 - Spark 2.2.2
Why Is the OBS Quick Deletion Directory Not Applied After Being Added to the Custom Hive Configuration? Hive Configuration Problems Parent topic: Using Hive
Cause Analysis When the load command is used to import data to the Hive table across file systems (for example, the original data is stored in the HDFS but the Hive table data is stored in the OBS), and the file length is greater than the threshold (32 MB by default).
Common Operation MRS Console FusionInsight Manager Changing subnets, adding security group rules, controlling OBS permissions, managing agencies, and synchronizing IAM users Supported Not supported Adding node groups, scaling out, scaling in, and upgrading specifications Supported
Cluster Management Failed to Reduce Task Nodes OBS Certificate in a Cluster Expired Replacing a Disk in an MRS Cluster (Applicable to 2.x and Earlier) Replacing a Disk in an MRS Cluster (Applicable to 3.x) Failed to Execute an MRS Backup Task Inconsistency Between df and du Command
