检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
Parameters of a Job for Migrating Data from MySQL to DWS Optimizing the Parameters of a Job for Migrating Data from MySQL to DMS for Kafka Optimizing the Parameters of a Job for Migrating Data from MySQL to Doris Optimizing the Parameters of a Job for Migrating Data from DMS for Kafka to OBS
Parameters MRS ClickHouse Connection Parameters MRS Hetu Connection Parameters MRS Impala Connection Parameters MRS Kafka Connection Parameters MRS Presto Connection Parameters MRS Ranger Connection Parameters Doris Connection Parameters OpenSource ClickHouse Connection Parameters OBS
Driver File Path Yes It specifies the OBS path where the driver file is located. You need to download a .jar driver file from the corresponding official website and upload it to OBS.
Driver File Path Yes It specifies the OBS path where the driver file is located. You need to download a .jar driver file from the corresponding official website and upload it to OBS.
When you use DataArts Studio, you may need to pay for the following services: OBS: During batch data migration or data development, DataArts Studio may write dirty data or logs to OBS, which incurs data storage fees. For details, see OBS Pricing Details.
Archive to OBS: Dirty data is stored in OBS and printed in job logs. Do not archive Write Dirty Data Link This parameter is displayed when Dirty Data Policy is set to Archive to OBS. Only links to OBS support dirty data writes.
Only links to OBS support dirty data writes. obs_link OBS Bucket This parameter is only displayed when Write Dirty Data Link is a link to OBS.
The value can be DWS, OBS, CSS, HIVE, DLI, or CUSTOM. OK Click OK to save the parameter settings. Cancel Click Cancel to cancel the parameter settings. Modify Click to modify the parameter settings. After the modification, save the settings.
The value can be DWS, OBS, CSS, HIVE, DLI, or CUSTOM. OK Click OK to save the parameter settings. Cancel Click Cancel to cancel the parameter settings. Modify Click to modify the parameter settings. After the modification, save the settings.
Configuring a Job for Synchronizing Data from MySQL to StarRocks (Internal Beta) Configuring a Job for Synchronizing Data from MySQL to Doris (Internal Beta) Configuring a Job for Synchronizing Data from DMS for Kafka to Doris Configuring a Job for Synchronizing Data from DMS for Kafka to OBS
Constraints on OBS During file migration, the system automatically transfers the files concurrently. In this case, Concurrent Extractors in the task configuration is invalid. Resumable transmission is not supported. If CDM fails to transfer files, OBS fragments are generated.
You can save the data in Table 1 to a CSV file in the OBS bucket. Then use a DLI SQL or DWS SQL statement to create an OBS foreign table, associate it with the CSV file, and use the query result of the OBS foreign table as the dataset.
You can save the data in Table 1 to a CSV file in the OBS bucket. Then use a DLI SQL or DWS SQL statement to create an OBS foreign table, associate it with the CSV file, and use the query result of the OBS foreign table as the dataset.
For details about how to create a bucket on the OBS console, see Creating a Bucket in Object Storage Service Console Operation Guide. Upload data to OBS bucket fast-demo.
It specifies the OBS path for storing the cluster configuration file. keytab File Path Yes This parameter is displayed when Authentication Method is set to KERBEROS. Select the OBS path where the keytab file is stored.
Only links to OBS support dirty data writes. obslink OBS Bucket This parameter is only displayed when Write Dirty Data Link is a link to OBS.
The default value is false. resources No Array of longs Resource ID array export_mode No String Export mode. null indicates that data is to be exported to a local file system, and obs indicates that data is to be exported to OBS.
The value can be DWS, OBS, CSS, HIVE, DLI, or CUSTOM. OK Click OK to save the parameter settings. Cancel Click Cancel to cancel the parameter settings. Modify Click to modify the parameter settings. After the modification, save the settings.
It specifies the OBS path for storing the cluster configuration file. keytab File Path Yes This parameter is displayed when Authentication Method is set to KERBEROS. Select the OBS path where the keytab file is stored.
The value can be DWS, OBS, CSS, HIVE, DLI, or CUSTOM. OK Click OK to save the parameter settings. Cancel Click Cancel to cancel the parameter settings. Modify Click to modify the parameter settings. After the modification, save the settings.
