检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
If files are also deleted when metadata is deleted, the metadata is moved to the recycle bin (OBS path lake-formation-trash-dir/table_id) of the corresponding OBS bucket. Parent topic: Metadata Management
services such as OBS and TMS.
Data Storage Location: Click , select a location for storing the table in the OBS parallel file system, for example, obs://lakeformation-test/catalog1/database1/table1, and click OK. Set other parameters based on the site requirements.
Location indicates the file directory of the OBS parallel file system mapped to the catalog. Databases Databases are stored in the data catalogs of a LakeFormation instance and multiple databases can be created under a catalog.
Console Instance Management Job Management Service Authorization Management OBS Management Access Management Specification Management Quota Management Service Tag Management Service Agency Management Alarm Management Metadata Management Location Parent topic: API
You have obtained the permission to perform operations on OBS and have created an OBS parallel file system for storing data. Export the permission policy files to be migrated and upload them to the OBS parallel file system.
Assume that path obs://a/b/c/d/e=1/f=99 exists and the data storage path is obs://a/b. Group level 2 indicates that d is used as the boundary. d is the table name. e=1 and f=99 indicate that table d is a partitioned table.
If a low-permission user lacks OBS path access permission for the default database, Spark will display a permission error message but will still successfully create the database.
Assume that path obs://a/b/c/d/e=1/f=99 exists and the data storage path is obs://a/b. Group level 2 indicates that d is used as the boundary. d is the table name. e=1 and f=99 indicate that table d is a partitioned table.
Location indicates the file directory of the OBS parallel file system mapped to the databases. Table You can create multiple tables in a database. Metadata such as basic information, format and serialization information, fields, and attributes are included in tables.
Enter a maximum of 4,000 characters. location No String Path, for example, obs://location/uri/. database_location_list No Array of strings List of database paths. A maximum of 1,000 paths can be displayed on the page. branch_name No String Branch name.
Check the status of the Ranger service. 500 00000050 OBS health check failed. Check whether the OBS service is normal and whether the AK/SK for calling OBS has expired. 500 00000051 Failed to create or update database metadata.
If an authorization is required, both the compute engine and OBS need to be authorized, which is inconvenient.
Fine-grained LakeFormation permissions grant access to metadata, OBS paths, and the data within them to entities, including users, user groups, and roles. The IAM permission model consists of IAM policies.
Enter a maximum of 4,000 characters. location No String Path, for example, obs://location/uri/. database_location_list No Array of strings List of database paths. A maximum of 1,000 paths can be displayed on the page. branch_name No String Branch name.
Enumeration values: IAM SAML LDAP LOCAL AGENTTENANT OTHER description String Database description. location String Database directory, for example, obs://location/uri/. data_statistic_enable Boolean Whether to enable data overview statistics.
Assume that path obs://a/b/c/d/e=1/f=99 exists and the data storage path is obs://a/b. Group level 2 indicates that d is used as the boundary. d is the table name. e=1 and f=99 indicate that table d is a partitioned table.
"IAM", "class_name" : "34", "create_time" : "2022-12-09T01:50:56.000+00:00", "resource_uris" : [ { "type" : "JAR", "uri" : "obs://lakeformation-test/" }, { "type" : "FILE", "uri" : "obs://lakeformation-test/test3/" } ] } Status code: 400 Bad Request {
Enumeration values: IAM SAML LDAP LOCAL AGENTTENANT OTHER description String Database description. location String Database directory, for example, obs://location/uri/. data_statistic_enable Boolean Whether to enable data overview statistics.
Interconnecting with OBS Add the following configuration items to the spark/conf/spark-defaults.conf file: # Fixed configuration for interconnecting with OBS.
