检测到您已登录华为云国际站账号,为了您更好的体验,建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
Object Storage Service (OBS) The actual service data mapped by LakeFormation metadata is stored in the directories and files of the OBS Buckets.
Tenant resources: LakeFormation needs to read user group and user information, create and delete OBS file directories, and access OBS tag permission APIs. Recommended Security Configuration N/A Infrastructure Security LakeFormation instances run in a cross-AZ cluster.
OBS Management OBS bucket management APIs, which allow you to query OBS buckets and objects. With these APIs, you can obtain the OBS information needed for configuring the storage path of metadata.
When there are both a folder and a file with the same name in the OBS directory, creating an OBS table pointing to that path will prioritize the file over the folder.
Set this parameter to the OBS storage path of the hive Catalog, which is obtained in Creating a LakeFormation Instance. Figure 1 Configuring hive.metastore.warehouse.dir Click Save. Interconnecting Spark with OBS If your cluster does not have the Spark component, skip this step.
If files are also deleted when metadata is deleted, the metadata is moved to the recycle bin (OBS path lake-formation-trash-dir/table_id) of the corresponding OBS bucket. Parent topic: LakeFormation Metadata Management
The location is the OBS Buckets file directory mapped to the catalog. Databases Databases are stored in the data catalogs of a LakeFormation instance and multiple databases can be created under a catalog.
services such as OBS and TMS.
Console Instance Management Job Management Service Authorization Management OBS Management Access Management Specification Management Quota Management Service Tag Management Service Agency Management Alarm Management Metadata Management Location Parent topic: API
If you choose to restore the data in the OBS recycle bin, ensure that there is available storage space in OBS. Otherwise, the data cannot be restored. Restoring Function Metadata Log in to the LakeFormation console.
If files are also deleted when metadata is deleted, the metadata is moved to the recycle bin (OBS path lake-formation-trash-dir/table_id) of the corresponding OBS bucket. Parent topic: LakeFormation Metadata Management
If files are also deleted when metadata is deleted, the metadata is moved to the recycle bin (OBS path lake-formation-trash-dir/table_id) of the corresponding OBS bucket. Parent topic: LakeFormation Metadata Management
You have obtained the permission to perform operations on OBS and have created an OBS parallel file system for storing data. Export the permission policy files to be migrated and upload them to the OBS parallel file system.
Assume that path obs://a/b/c/d/e=1/f=99 exists and the data storage path is obs://a/b. Group level 2 indicates that d is used as the boundary. d is the table name. e=1 and f=99 indicate that table d is a partitioned table.
If a low-permission user lacks OBS path access permission for the default database, Spark will display a permission error message but will still successfully create the database.
Assume that path obs://a/b/c/d/e=1/f=99 exists and the data storage path is obs://a/b. Group level 2 indicates that d is used as the boundary. d is the table name. e=1 and f=99 indicate that table d is a partitioned table.
Location indicates the file directory of the OBS parallel file system mapped to the databases. Table You can create multiple tables in a database. Metadata such as basic information, format and serialization information, fields, and attributes are included in tables.
Enter a maximum of 4,000 characters. location No String Path, for example, obs://location/uri/. database_location_list No Array of strings List of database paths. A maximum of 1,000 paths can be displayed on the page. branch_name No String Branch name.
Check the status of the Ranger service. 500 00000050 OBS health check failed. Check whether the OBS service is normal and whether the AK/SK for calling OBS has expired. 500 00000051 Failed to create or update database metadata.
If an authorization is required, both the compute engine and OBS need to be authorized, which is inconvenient.