检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
Figure 2 Exporting scripts Importing Scripts This function is available only if the OBS service is available. If OBS is unavailable, scripts can be imported from the local PC. You can import one or more script files in the script directory.
OBS path: OBS 2. DLI package: DLIResources jobClass No String Main class name.
Log Path Path of the OBS bucket for storing job logs. By default, logs are stored in an OBS bucket named dlf-log-{Projectid}.
Configuring Destination Job Parameters To PostgreSQL To Oracle To MySQL To SQLServer To Hudi To Hive To DLI To Elasticsearch To DWS To OBS To SAP HANA To ClickHouse To Doris To HBase To MongoDB To MRS Kafka To GBase To Redis To HDFS Parent topic: DataArts Migration (Offline Jobs)
Configuring Resources Configuring Environment Variables Configuring an OBS Bucket Managing Job Tags Configuring a Scheduling Identity Configuring the Number of Concurrently Running Nodes Configuring a Template Configuring a Scheduling Calendar Configuring a Default Item Configuring
Configuring CDM Destination Job Parameters To OBS To HDFS To HBase/CloudTable To Hive To MySQL/SQL Server/PostgreSQL To Oracle To DWS To DDS To Redis To Elasticsearch/CSS To DLI To OpenTSDB To MRS Hudi To MRS ClickHouse To MongoDB Parent topic: Creating a Job in a CDM Cluster
OBS OBS Bucket Select the OBS bucket from which data will be collected. OBS Path Select the path of the OBS bucket from which data will be collected. Collection Scope Select the range of data to be collected.
Cluster Management Querying the List of Cluster Overview Information Querying the List of Cluster Details Querying Cluster Details Querying Access Logs of a DataArts DataService Cluster Enabling Log Dump to OBS for a DataArts DataService Cluster Enabling Log Dump to LTS for a DataArts
You can select the OBS link where the list file is located. OBS_test_link OBS Bucket of entries files This parameter is available only when Pull List File is set to Yes.
Link Parameter Description Link to a Relational Database Link to OBS Link to HDFS Link to HBase Link to CloudTable Link to Hive Link to an FTP or SFTP Server Link to MongoDB Link to Redis Link to Kafka Link to DIS Link to Elasticsearch/Cloud Search Service Link to DLI Link to DMS
OBS storage support Yes Whether to support OBS storage. If the Hudi table data is stored in OBS, you need to enable this function. Use Agency No This parameter is displayed when OBS storage support is enabled.
This parameter is mandatory when OBS is supported. You are advised to store it in ciphertext in the configuration file or an environment variable and decrypt it when needed to ensure security. linkConfig.securityKey No String SK.
Driver Source Yes Source of the driver file Driver File Path Yes This parameter is mandatory when Driver File Source is set to OBS path. It specifies the OBS path where the driver file is located.
OBS DataArts Studio uses Object Storage Service (OBS) buckets to store logs. SMN DataArts Studio uses Simple Message Notification (SMN) to send push notifications based on your subscription requirements, so that you can receive immediate notifications when specific events occur.
Configuring Source Job Parameters From MySQL From Hive From HDFS From Hudi From PostgreSQL From SQLServer From Oracle From DLI From OBS From SAP HANA From Kafka From DWS From FTP/SFTP From Doris From HBase From ClickHouse From Elasticsearch From MongoDB From RestApi From GBase From
The default value is |. fromJobConfig.useQuery No Boolean If you set this parameter to true, the name of the objects uploaded to OBS does not carry the query parameter.
You can select the OBS link where the list file is located. OBS_test_link OBS Bucket of entries files This parameter is available only when Entries Files is set to Yes.
- OBS storage support The server must support OBS storage. When creating a Hive table, you can store the table in OBS. No AK This parameter is mandatory when OBS storage support is enabled.
Configuring a Job for Synchronizing Data from Oracle to MRS Hudi Message system DMS for Kafka Object-based storage: Object Storage Service (OBS) Configuring a Job for Synchronizing Data from DMS for Kafka to OBS Apache Kafka Hadoop: MRS Kafka NOTE: This connection is available only
OMS OMS helps you migrate data from object storage on other clouds online to the OBS on HUAWEI CLOUD. For details, see Object Storage Migration Service.
