检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
String OBS path of the truststore configuration file keystore_location String OBS path of the keystore configuration file owner String Username Example Request None Example Response { "count": 19, "auth_infos": [{ "auth_info_name": "lan2", "datasource_type": "Kafka_SSL",
In the current version, the location must be specified and can only be set to an OBS path. Creating a table by delta.'Obs path' means the table cannot be found with show tables.
For example, if you select obs://bucket/src1/ as the bucket path, then The job result export path is obs://bucket/src1/test.csv. Export Mode Yes New OBS directory If you select this mode, a new folder path is created and the job results are saved to this path.
is the actual OBS path for storing data.
Check whether the user group has the permission to write data to OBS, for example, OBS OperateAccess. If the user group does not have the OBS write permission, grant the permission to the user group. Wait for 5 to 10 minutes for the permission to take effect.
How Do I Fix Incorrect Data in an OBS Foreign Table Caused by Newline Characters in OBS File Fields? How Do I Prevent a Cartesian Product Query and Resource Overload Due to Missing "ON" Conditions in Table Joins?
NOTE: Currently, Schema supports only OBS and HDFS. If schema is set to obs, data is stored to OBS. Note that OBS directory must be a parallel file system and must not be an OBS bucket.
Available values are CSS, KRB, passwd, and Kafka_SSL. krb5_conf No String OBS path of the krb5 configuration file keytab No String OBS path of the keytab configuration file truststore_location No String OBS path of the truststore configuration file truststore_password No String Password
OBS table Data in OBS tables is stored in the OBS service, which is suitable for latency-insensitive services, such as historical data statistics and analysis. An OBS table stores data in the form of objects. Each object contains data and related metadata.
Available values are CSS, KRB, passwd, and Kafka_SSL. krb5_conf No String OBS path of the krb5 configuration file keytab No String OBS path of the keytab configuration file truststore_location No String OBS path of the truststore configuration file truststore_password No String Password
How Do I Use DLI to Access Data in an OBS Bucket? How Do I Specify an OBS Path When Creating an OBS Table? How Do I Create a Table Using JSON Data in an OBS Bucket? How Can I Use the count Function to Perform Aggregation? How Do I Synchronize DLI Table Data Across Regions?
EXTERNAL: Indicates an OBS table. MANAGED: Indicates a DLI table. VIEW: Indicates a view. partition_columns No Array of Strings Partition field. This parameter is valid only for OBS partition tables.
EXTERNAL: Indicates an OBS table. MANAGED: Indicates a DLI table. VIEW: Indicates a view. partition_columns No Array of Strings Partition field. This parameter is valid only for OBS partition tables. page-size No Integer Paging size.
Table 1 SQL syntax of batch jobs Classification Reference Database-related Syntax Creating a Database Deleting a Database Checking a Specified Database Checking All Databases Syntax for Creating an OBS Table Creating an OBS Table Using the Datasource Syntax Creating an OBS Table Using
When this parameter is set to true: After a file is deleted from a non-partitioned OBS table, the table directory is also deleted. The custom partition data in the partitioned OBS table is also deleted. dli.lifecycle.trash.dir No This parameter is available only for OBS tables.
Figure 10 Generating a JAR file Log in to the OBS console and upload the file to the OBS path. The region of the OBS bucket to which the Jar package is uploaded must be the same as the region of the DLI queue. Cross-region operations are not allowed.
Resource Planning and Costs Table 1 Resource planning and costs Resource Description Cost OBS You need to create an OBS bucket and upload data to OBS for data analysis using DLI.
Solution Check the permissions of the OBS bucket to ensure that the account has access to the OBS bucket mentioned in the error message. If not, contact the OBS bucket administrator to add access permissions of the bucket. Parent topic: SQL Job O&M
Notes Do not use the OBS bucket for other purposes. The OBS bucket must be set and modified by the main account. Member users do not have the permission. If the bucket is not configured, you will not be able to view job logs.
Log in to OBS console and create a directory for storing the DLI Livy JAR package in the specified OBS bucket, for example: obs://bucket/livy/jars/.
