检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
OBS table Data in OBS tables is stored in the OBS service, which is suitable for latency-insensitive services, such as historical data statistics and analysis. An OBS table stores data in the form of objects. Each object contains data and related metadata.
Check whether the user group has the permission to write data to OBS, for example, OBS OperateAccess. If the user group does not have the OBS write permission, grant the permission to the user group. Wait for 5 to 10 minutes for the permission to take effect.
NOTE: Currently, Schema supports only OBS and HDFS. If schema is set to obs, data is stored to OBS. Note that OBS directory must be a parallel file system and must not be an OBS bucket.
Available values are CSS, KRB, passwd, and Kafka_SSL. krb5_conf No String OBS path of the krb5 configuration file keytab No String OBS path of the keytab configuration file truststore_location No String OBS path of the truststore configuration file truststore_password No String Password
Available values are CSS, KRB, passwd, and Kafka_SSL. krb5_conf No String OBS path of the krb5 configuration file keytab No String OBS path of the keytab configuration file truststore_location No String OBS path of the truststore configuration file truststore_password No String Password
Table 1 SQL syntax of batch jobs Classification Reference Database-related Syntax Creating a Database Deleting a Database Checking a Specified Database Checking All Databases Syntax for Creating an OBS Table Creating an OBS Table Using the Datasource Syntax Creating an OBS Table Using
How Do I Use DLI to Access Data in an OBS Bucket? How Do I Specify an OBS Path When Creating an OBS Table? How Do I Create a Table Using JSON Data in an OBS Bucket? How Can I Use the count Function to Perform Aggregation? How Do I Synchronize DLI Table Data Across Regions?
EXTERNAL: Indicates an OBS table. MANAGED: Indicates a DLI table. VIEW: Indicates a view. partition_columns No Array of Strings Partition field. This parameter is valid only for OBS partition tables.
Figure 10 Generating a JAR file Log in to the OBS console and upload the file to the OBS path. The region of the OBS bucket to which the Jar package is uploaded must be the same as the region of the DLI queue. Cross-region operations are not allowed.
EXTERNAL: Indicates an OBS table. MANAGED: Indicates a DLI table. VIEW: Indicates a view. partition_columns No Array of Strings Partition field. This parameter is valid only for OBS partition tables. page-size No Integer Paging size.
When this parameter is set to true: After a file is deleted from a non-partitioned OBS table, the table directory is also deleted. The custom partition data in the partitioned OBS table is also deleted. dli.lifecycle.trash.dir No This parameter is available only for OBS tables.
Solution Check the permissions of the OBS bucket to ensure that the account has access to the OBS bucket mentioned in the error message. If not, contact the OBS bucket administrator to add access permissions of the bucket. Parent topic: SQL Job O&M
Resource Planning and Costs Table 1 Resource planning and costs Resource Description Cost OBS You need to create an OBS bucket and upload data to OBS for data analysis using DLI.
Notes Do not use the OBS bucket for other purposes. The OBS bucket must be set and modified by the main account. Member users do not have the permission. If the bucket is not configured, you will not be able to view job logs.
path of the krb5 configuration file keytab No String OBS path of the keytab configuration file truststore_location No String OBS path of the truststore configuration file truststore_password No String Password of the truststore configuration file keystore_location No String OBS path
Make sure you have authorized operations on OBS before using it.
Currently, the multiversion function supports only OBS tables created using the Hive syntax. For details about the syntax for creating a table, see Creating an OBS Table Using the Hive Syntax. Syntax Enable the multiversion function.
of letters, numbers, and underscores (_) bucket_name OBS bucket name tbl_path Storage location of the Delta table in the OBS bucket num Retention period Required Permissions SQL permissions Table 2 Permissions required for executing VACUUM Permission Description UPDATE permission
NOTE: This parameter is mandatory for an OBS table. data_path No String Storage path of data in the new OBS table, which must be a path on OBS and must begin with obs. NOTE: This parameter is mandatory for an OBS table. Do not set this parameter to the OBS root directory.
Log in to OBS console and create a directory for storing the DLI Livy JAR package in the specified OBS bucket, for example: obs://bucket/livy/jars/.
