检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
Script Path obs://mrs-samples/xxx.sh Script path. The value can be an OBS file system path or a local VM path. An OBS file system path must start with obs:// and end with .sh, for example, obs://mrs-samples/xxx.sh. A local VM path must start with a slash (/) and end with .sh.
OBS to HBase Typical Scenario: Importing Data from a Relational Database to ClickHouse Typical Scenario: Importing Data from HDFS to ClickHouse Parent topic: Using Loader
from an FTP Server to HBase Using Loader to Import Data from a Relational Database to HDFS or OBS Using Loader to Import Data from a Relational Database to HBase Using Loader to Import Data from a Relational Database to Hive Using Loader to Import Data from HDFS or OBS to HBase Using
OBS Path: obs://sparksql/input/sparksql-test.txt HDFS Path: /user/userinput Figure 1 Importing data from OBS to HDFS Submit the SQL statement. On the details page of the MRS cluster, click the Jobs tab. For details, see Running a Spark Job.
Output path should be a directory that does not exist, for example, obs://obs-demo-analysis-hwt4/output/. NOTE: To obtain the AK/SK for accessing OBS, perform the following steps: Log in to the Huawei Cloud management console.
Configuring Storage-Compute Decoupling for an MRS Cluster Configuration Process Interconnecting an MRS Cluster with OBS Using an IAM Agency Interconnecting an MRS Cluster with OBS Through Guardian FAQ About Decoupled Storage and Compute
Migrating Data from MRS HDFS to OBS This practice demonstrates how to migrate file data from MRS HDFS to OBS using CDM. System Interconnection Using DBeaver to Access Phoenix This practice describes how to use DBeaver to access Phoenix.
storage location of the table partition to another bucket does not take effect. alter table table_name partition(dt date) set location "obs://OBS bucket 2/Folder in the bucket"; Parent topic: Application Development
storage location of the table partition to another bucket does not take effect. alter table table_name partition(dt date) set location "obs://OBS bucket 2/Folder in the bucket"; Parent topic: Application Development
storage location of the table partition to another bucket does not take effect. alter table table_name partition(dt date) set location "obs://OBS bucket 2/Folder in the bucket"; Parent topic: Developing Impala Applications
storage location of the table partition to another bucket does not take effect. alter table table_name partition(dt date) set location "obs://OBS bucket 2/Folder in the bucket"; Parent topic: Developing a Hive Application
You can enter the path or click HDFS or OBS to select a file. The path can contain a maximum of 1,023 characters. It cannot contain special characters (;|&>,<'$) and cannot be left blank or all spaces. The OBS program path starts with obs://.
Data Analytics Using Spark2x to Analyze IoV Drivers' Driving Behavior Using Hive to Load HDFS Data and Analyze Book Scores Using Hive to Load OBS Data and Analyze Enterprise Employee Information Using Flink Jobs to Process OBS Data Consuming Kafka Data Using Spark Streaming Jobs Using
Supported OBS monitoring. Upgraded the OBS packages. Resolved the issue that some data is not inserted when 10 data records are concurrently inserted into hive-jdbc. Resolved the issue that Hive occasionally reports a Kryo deserialization failure.
OBS: logs are saved to OBS. This is the default option. Go to 5. Set OBS Path to the OBS path for storing service log files. Enter a full path that does not start with a slash (/) and is no more than 900 bytes. The system will automatically create the path if it does not exist.
Creating an OBS Parallel File System and Obtaining the AK/SK and Domain ID Create an OBS parallel file system. Log in to the OBS console. Choose Parallel File Systems > Create Parallel File System. Enter a file system name, for example, doris-obs.
//mrs-demotest/input/data2.txt --output obs://mrs-demotest/output.txt Run the following command to submit a single job on YARN: flink run -m yarn-cluster /opt/flinkclient/Flink/flink/examples/batch/WordCount.jar --input obs://mrs-demotest/input/data2.txt --output obs://mrs-demotest
Fine-grained authentication for OBS storage-compute decoupled clusters If you want to perform fine-grained permission control on OBS resources in OBS storage-compute decoupled clusters, MRS provides you with a fine-grained permission control solution based on the IAM agency.
Why Hive Tables in the OBS Directory Fail to Be Deleted? Why Does an OBS Quickly Deleted Directory Not Take Effect After Being Added to the Customized Hive Configuration? Parent topic: Using Hive
Supported OBS monitoring. Upgraded the OBS packages. Resolved the issue that some data is not inserted when 10 data records are concurrently inserted into hive-jdbc. Resolved the issue that Hive occasionally reports a Kryo deserialization failure.
