检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
Bucket Click the Bucket drop-down list or the "Refresh" icon and select the Huawei Cloud OBS bucket for storing the migrated data. The bucket must be located in the region where you are using OMS. Click Next. Configure parameters in the Source Configuration area.
OBS LWLock event OBSGetPathLock Prevents concurrent read/write or concurrent write/write on an OBS path. OBS LWLock event OBSRuntimeLock Obtains environment variables, for example, GAUSSHOME.
OBS Bucket: Select an OBS bucket for storing job logs and grant access permissions of the OBS bucket as prompted. Enable Checkpointing: Enable this function. Enter a SQL statement in the editing pane. The following is an example. Modify the parameters in bold as you need.
val sparkSession = SparkSession.builder().getOrCreate() val sc = sparkSession.sparkContext sc.addFile("OBS address of krb5.conf") sc.addFile("OBS address of user.keytab") Thread.sleep(10) val krb5_startfile = new File(SparkFiles.get("krb5.conf")) val keytab_startfile
Trace transfer: Traces are transferred to Object Storage Service (OBS) buckets on a regular basis for long-term storage. In this process, traces are compressed into trace files by service.
Data Flows you set the dump destination to MapReduce Service (MRS), Data Warehouse Service (DWS), or Data Lake Insight (DLI), the streaming data is first transferred to OBS before being dumped to MRS, DWS, or DLI. Parent topic: Overview
The default value is false. obs_bucket No String Name of an OBS bucket. root_id No Integer Parent job ID. edge_group_ids No Array of Strings List of edge computing group IDs.
Value ranges: 10.0.0.0/8-24, 172.16.0.0/12-24, 192.168.0.0/16-24. 172.16.4.0/24 obs_bucket_name string No Name of the OBS parallel file system, which must be unique. If OBS is not used for HANA backup, leave this parameter blank.
Table 6 StorageDescriptor Parameter Type Description columns Array of Column objects All fields except partition columns. location String Path, for example, obs://location/uri/. compressed Boolean Whether to enable data compression.
Figure 7 Orchestrating a job The node configurations are as follows: source_sdi: a CDM Job node, which is used to import data from OBS to the original table in MRS Hive.
Default value: off acceleration_with_compute_pool Parameter description: Specifies whether to use the computing resource pool for acceleration when OBS is queried.
Minimum: 1 Maximum: 51200 template_uri No String Specifies the URL address of the OBS bucket where a conformance package template was stored. Minimum: 0 Maximum: 1024 vars_structure No Array of VarsStructure objects Specifies the parameters of a conformance package.
For example, the cloud service type code of OBS is hws.service.type.obs.
For example, the cloud service type code of OBS is hws.service.type.obs.
For example, the cloud service type code of OBS is hws.service.type.obs. To obtain a specific service type, call the API in Querying Cloud Service Types. Table 5 AmountInfo Parameter Type Description discountList List<DiscountItem> Fee item.
For example, the cloud service type code of OBS is hws.service.type.obs. To obtain a specific service type, call the API in Querying Cloud Service Types. regionCode No String A maximum of 64 characters Cloud service region code, for example, ap-southeast-1.
You have uploaded the media asset files to an OBS bucket in the region of MPC, and authorized MPC to access the OBS bucket. For details, see Uploading Media Files and Authorizing Access to Cloud Resources. For details about the SDK version, see SDK Center.
/v1/cloudimages/quota ims:quotas:get - PUT /v1/cloudimages/{image_id}/upload PUT /v2/images/{image_id}/file ims:images:upload ims:images:get ims:images:update POST /v1/cloudimages/wholeimages/action ims:wholeImages:create - POST /v1/cloudimages/{image_id}/file ims:images:export obs
Set this parameter when a DLI or SQL script is created. none bzip2 deflate gzip Storage Path Yes OBS path where the result file is stored. After selecting an OBS path, customize a folder. Then, the system will create it automatically for storing the result file.
OBSList Traverses an OBS directory. OBSRead Reads an OBS object. OBSWrite Writes an OBS object. LOGCTRL_SLEEP Waits for the standby node to catch up with logs. ShareStorageWalRead Reads log files from the shared disk. ShareStorageWalWrite Writes log files to the shared disk.
