检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
Why Is Error "path obs://xxx already exists" Reported When Data Is Exported to OBS? This message indicates that you are exporting data to an existing OBS path. Solution: Create an OBS directory.
Granting OBS Permissions to DLI Function This API is used to grant DLI the permission to access OBS buckets for saving job checkpoints and run logs. This API has been discarded and is not recommended.
to obs://bucketName/datapath.
OBS OBS Source Table OBS Result Table Parent topic: Connectors
OBS Result Table Function The FileSystem result (sink) table is used to export data to the HDFS or OBS file system. It is applicable to scenarios such as data dumping, big data analysis, data backup, and active, deep, or cold archiving.
Using DLI to Submit a SQL Job to Query OBS Data Scenario DLI can query data stored in OBS. This section describes how to use DLI to submit a SQL job to query OBS data. To illustrate, create a new file called sampledata.csv and upload it to an OBS bucket.
OBS Source Table Function The file system connector can be used to read single files or entire directories into a single table. When using a directory as the source path, there is no defined order of ingestion for the files inside the directory.
Renaming a Partition (Only OBS Tables Supported) Function This statement is used to rename partitions.
Read the people.json file from the OBS bucket. dli-test-obs01 is the name of the sample OBS bucket. Replace it with the actual OBS bucket name.
Why Is No Data Queried in the DLI Table Created Using the OBS File Path When Data Is Written to OBS by a Flink Job Output Stream? Symptom After data is written to OBS through the Flink job output stream, data cannot be queried from the DLI table created in the OBS file path.
data exists in the OBS path.
Create a non-partitioned OBS table. Specify an OBS file and create an OBS table for the CSV data.
CSV Path You can directly enter a path or click and select an OBS path. If no bucket is available, you can directly switch to the OBS management console and create an OBS bucket. When creating an OBS table, you must specify a folder as the directory.
How Do I Fix Incorrect Data in an OBS Foreign Table Caused by Newline Characters in OBS File Fields? Symptom When an OBS foreign table is created, a field in the specified OBS file contains a carriage return line feed (CRLF) character. As a result, the data is incorrect.
For details, see Creating an OBS Table Using the Hive Syntax. Parent topic: Creating an OBS Table
How Do I Use DLI to Access Data in an OBS Bucket? Create an OBS Table. For details about the creation syntax, see Creating an OBS Table Using the DataSource Syntax. Add partitions. For details about the partitioning syntax, see Adding a Partition.
Example 1: Creating an OBS Non-Partitioned Table Example description: Create an OBS non-partitioned table named table1 and use the STORED AS keyword to set the storage format of the table to orc.
Can I Import OBS Bucket Data Shared by Other Tenants into DLI? DLI supports importing data from OBS buckets shared by IAM users under the same tenant, but not from OBS buckets shared by other tenants. This ensures data security and isolation.
How Do I Specify an OBS Path When Creating an OBS Table? Scenario When creating an OBS table, you must specify a table path in the database. The path format is as follows: obs://xxx/database name/table name.
Creating an OBS Table Creating an OBS Table Using the DataSource Syntax Creating an OBS Table Using the Hive Syntax Parent topic: Tables
