检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
Planning and creating an OBS bucket and importing data Create an OBS bucket and folders for data storage. Planning and creating catalogs and databases Create catalogs and databases on the LakeFormation page and specify the OBS bucket directory.
Table 1 Permissions Service Role Policy Function System administrator { "Version": "1.1", "Statement": [ { "Effect": "Allow", "Action": [ "DataArtsFabric:*:*", "obs:bucket;*", "obs:object:*" ] } ] } With all DataArtsFabric permissions, this role can perform all DataArtsFabric operations
Users can efficiently and swiftly use LakeFormation metadata and OBS data using SQL syntax. DataArts Fabric SQL currently only supports access from IAM users. Parent topic: Designing Database Objects
Planning and Creating an OBS Parallel File System and Importing Data DataArtsFabric SQL uses OBS to store data. You need to create a parallel file system and folders on the OBS console and import sample data. Log in to the management console.
FABRIC_OBS_POLICY obs:bucket:PutLifecycleConfiguration obs:bucket:ListBucketMultipartUploads obs:object:GetObject obs:bucket:HeadBucket obs:bucket:DeleteBucket obs:bucket:CreateBucket obs:bucket:ListAllMyBuckets obs:bucket:ListBucket obs:object:PutObject No Permissions required by
You have enabled LakeFormation and OBS permissions and confirmed the agency. You have a workspace available. Step 1: Plan and Create an OBS Bucket and Import Data DataArts Fabric SQL uses OBS to store data.
Accessing Iceberg Tables Created by Third-Party Engines For an Iceberg table generated by Spark, DataArts Fabric SQL accesses Iceberg data on OBS through external tables. Obtain the corresponding OBS path access permissions. Log in to the Huawei Cloud LakeFormation console.
Robert Algorithm engineer DataArtsFabricFullPolicy and required OBS permissions are required. To use model files in OBS in DataArts Fabric, some OBS permissions need to be granted by the user permission administrator Tom.
You can view the output results in the OBS bucket path.
You have created an OBS bucket and folders for storing models, uploaded model files that meet the requirements, and ensured that the OBS bucket for storing models is in the same region as DataArtsFabric. For details, see Creating an OBS Bucket.
You have created an OBS bucket and folders for storing models, uploaded model files that meet the requirements, and ensured that the OBS bucket for storing models is in the same region as DataArtsFabric. For details, see Creating an OBS Bucket.
=OBS_SERVER, # OBS access address.
SELECT * from iceberg_remove_orphanfiles('iceberg_test'); orphan_file_location ------------------------------------------------------------- obs://xxxx/test.txt obs://xxxx/test2.txt (2 rows) Parent topic: SQL on Iceberg
The value must be a valid OBS path. OBS buckets and parallel file systems are supported. If the path is an OBS bucket path, the table is read-only. Otherwise, the table can be read and written.
=OBS_SERVER, # OBS access address.
OBS I/O: details about an OBS I/O request. count indicates the total number of OBS I/O requests. averageRTT indicates the average round trip time (RTT) of OBS I/O requests. The unit is μs. averageLatency indicates the average latency of OBS I/O requests.
Creating a model OBS To create a model and specify its OBS file path on the model management page, an IAM user must have the DataArtsFabricFullPolicy and OBS OperateAccess policies.
The image package version must be the same as the version of the selected OBS file package. Version Description Description of the version to be created. Version Type Currently, only OBS is supported. Path OBS path of the version to be created.
Use cstore_buffers to specify the cache of ORC, Parquet, or CarbonData metadata and data for OBS or HDFS foreign tables. The metadata cache size should be 1/4 of cstore_buffers and not exceed 2 GB.
Unit: μs. obs_io_req_latency_gt_1s bigint Count of OBS I/O request delays exceeding 1s. Unit: times. obs_io_req_latency_gt_10s bigint Count of OBS I/O request delays exceeding 10s. Unit: times. obs_io_req_count bigint Number of OBS I/O requests.
