检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
In the dialog box that is displayed, select Success percent of OBS data read operation interface calls from OBS data read operation, and click OK. Check whether the average time of OBS metadata API calls exceeds the threshold. If yes, go to Step 3. If no, go to Step 5.
Typical Scenario: Exporting Data from HDFS or OBS to an SFTP Server Scenario This section describes how to use Loader to export data from HDFS or OBS to an SFTP server. Prerequisites You have obtained the service username and password for creating a Loader job.
Typical Scenario: Exporting Data from HDFS or OBS to a Relational Database Scenario This section describes how to use Loader to export data from HDFS or OBS to a relational database. Prerequisites You have obtained the service username and password for creating a Loader job.
Possible Causes Connection to the OBS server fails. The specified OBS file system does not exist. The user AK/SK information is invalid. The local OBS configuration cannot be obtained. Procedure Log in to the OBS server and check whether the OBS server can be properly accessed.
Description of Hive Table Location (Either Be an OBS or HDFS Path) Question Can Hive tables be stored in OBS or HDFS? Answer The location of a common Hive table stored on OBS can be set to an HDFS path.
Using Loader to Export Data from HDFS or OBS to a Relational Database Scenario This section describes how to use Loader to export data from HDFS or OBS to a relational database. Prerequisites You have obtained the service username and password for creating a Loader job.
Using Loader to Export Data from HDFS or OBS to an SFTP Server Scenario This section describes how to use Loader to export data from HDFS or OBS to an SFTP server. Prerequisites You have obtained the service username and password for creating a Loader job.
How Do I Migrate Data from OBS to ClickHouse? Question How do I migrate data from OBS/S3 to ClickHouse?
How Do I Read Encrypted OBS Data When Running an MRS Job? In MRS 1.9.x encrypted data in OBS file systems can be used to run jobs, and the encrypted job running results can be stored in OBS file systems. Currently, data can be accessed only through an OBS protocol.
OBS file system, the read and write performance may be affected.
the OBS directory.
How Do I Access OBS Using an MRS Client Installed Outside a Cluster?
How Do I Connect an MRS Cluster Client to OBS Using an AK/SK Pair? In MRS 1.9.2 or later, you can connect MRS clusters to OBS using obs://. Currently, supported components are Hadoop, Hive, Spark, Presto, and Flink. HBase cannot use obs:// to interconnect with OBS.
What Should I Do If Data Failed to Be Synchronized to a Hive Table on the OBS Using hive-table? Question What should I do if data failed to be synchronized to a Hive table on the OBS using hive-table? Answer Change -hive-table to -hcatalog-table.
Answer: When a user submits a job that needs to read and write OBS, the job submission program adds the temporary access key (AK) and secret key (SK) for accessing OBS by default. The temporary AK and SK have expiration time.
Why Do I Fail to Create a Table in the Specified Location on OBS After Logging to spark-beeline? Question When the OBS ECS/BMS image cluster is connected, after spark-beeline is logged in, an error is reported when a location is specified to create a table on OBS.
Failed to Use Sqoop to Read MySQL Data and Write Parquet Files to OBS Issue An error is reported when Sqoop reads MySQL data and writes the data to OBS in Parquet format. However, the data can be successfully written to OBS if the Parquet format is not specified.
What Should I Do If the Error Message "requestId=XXX" Is Displayed When a Spark Job Accesses OBS? Symptom Error message "requestId=4971883851071737250" is displayed when a Spark job accesses OBS.
You have had the permission to access the HDFS or OBS directories and data involved in job execution. You have had the permission to access the HBase tables or phoenix tables that are used during job execution.
A User Without the Permission on the /tmp Directory Failed to Execute a Job for Accessing OBS Symptom When multiple MRS users access OBS and execute Spark, Hive, and Presto jobs, an error message is displayed, indicating that a user does not have the permission to access the /tmp
