检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
You can save the content in .tfvars to a file, upload the file to OBS, and transfer the pre-signed URL of OBS to vars_uri. Stack sets do not encrypt sensitive data.
Through this agency, you delete OBS permissions to CSS, so that CSS will be able to back up log files to your OBS buckets. Constraints: This parameter is mandatory when action is not set to real_time_log_collect.
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ALL,on(),off(COMMAND,GUC,GSCLEAN,SLRU,MEM_CTL,AUTOVAC,CACHE,ADIO,SSL,GDS,TBLSPC,WLM,OBS
For example, the cloud service type code of OBS is hws.service.type.obs. service_type_name String A maximum of 200 characters Cloud service type.
For example, the cloud service type code of OBS is hws.service.type.obs. service_type_name String A maximum of 200 characters Cloud service type.
Table 2 Query Parameters Parameter Mandatory Type Description filter No String Permission policy filter expression, which is not supported currently. obs_authorized_location No String This API is used to query all metadata permissions that contain the OBS path with the OBS path permission
Action Array of strings Specifies OBS access permissions. Resource Array of strings Specifies the OBS object. Example Requests Querying VPC endpoints GET https://{endpoint}/v1/{project_id}/vpc-endpoints?
Select Save Job Log, and specify the OBS bucket for saving job logs. Change the values of the parameters in bold as needed in the following script.
When using Loader to export data from HDFS or OBS, the input paths and input path subdirectories of the HDFSor OBS data source and the name of the files in these directories do not contain any of the following special characters: /\"':;,.
Select Save Job Log, and specify the OBS bucket for saving job logs. Change the values of the parameters in bold as needed in the following script.
You can select an HDFS or OBS path. - Output Data Path Data output path. You can select an HDFS or OBS path. - Job Status Polling Interval (s) Interval for querying job running status.
OBS storage support No This parameter is displayed when DataArts Migration is selected for Applicable Modules. The server must support OBS storage. When creating a Hive table, you can store the table in OBS.
Archive to OBS: Dirty data is stored in OBS and printed in job logs. Do not archive Write Dirty Data Link This parameter is displayed when Dirty Data Policy is set to Archive to OBS.
However, if you transfer logs to OBS or Data Ingestion Service (DIS), you will be billed by OBS or DIS respectively. For details, see Huawei Cloud Pricing.
When using Loader to export data from HDFS or OBS, the input paths and input path subdirectories of the HDFSor OBS data source and the name of the files in these directories do not contain any of the following special characters: /\"':;,.
The start time must be earlier than the end time. object No String Path for storing M3U8 files in an OBS bucket.
Restrictions To create a bucket, you must have the obs:bucket:CreateBucket permission. IAM is recommended for granting permissions. For details, see IAM Custom Policies. The mapping between OBS regions and endpoints must comply with what is listed in Regions and Endpoints.
Select the encoding mode of the data file to be written to the OBS data source. The value can be UTF-8 or GBK. Path Enter the path of the data files to be written to in the OBS data source. The path cannot end with a slash (/) or be set to the root directory of an OBS bucket.
Figure 1 Viewing logs Obtain the folder of the archived logs in the OBS directory. The details are as follows: Spark SQL jobs: Locate the log folder whose name contains driver or container_ xxx _000001.
Before selecting a resource package, you need to upload the JAR package and its dependency packages to the OBS bucket and create resources on the resource management page. For details, see Creating a Resource.
