检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
Yes OBS Link of List File Select an existing OBS link. obs_link OBS Bucket of entries files Name of the OBS bucket that stores the text file obs-cdm Path/Directory of entries files Custom OBS directories that store the text file.
Day OBS Link for Writing Backups Link used to back up jobs to OBS buckets.
It is used to configure OBS files. No OBS Link Select an OBS link. obs_link OBS Bucket Select an OBS bucket. obs_test Config File Select the OBS configuration file. /obs/config.csv Max. Poll Records (Optional) Maximum number of records per poll 100 Max.
(OBS) NoSQL cannot serve as the destination.
Binary files cannot. obsutil is recommended for migrating data from HTTP servers to OBS. For details, see Introduction to obsutil.
Database Sharding Data warehouse: Data Lake Insight (DLI) Hadoop: MRS HBase and MRS Hive Search: Elasticsearch and Cloud Search Service (CSS) Object-based storage: Object Storage Service (OBS) Database shards cannot serve as the destination.
No AK This parameter is mandatory when OBS storage support is enabled. The account corresponding to the AK/SK pair must have the OBS Buckets Viewer permission. Otherwise, OBS cannot be accessed and the "403 AccessDenied" error is reported.
Database Sharding Data warehouse: Data Lake Insight (DLI) Hadoop: MRS HBase and MRS Hive Search: Elasticsearch and Cloud Search Service (CSS) Object-based storage: Object Storage Service (OBS) Database shards cannot serve as the destination.
Database sharding Data warehouse: Data Lake Insight (DLI) Hadoop: MRS HBase and MRS Hive Search: Elasticsearch and Cloud Search Service (CSS) Object-based storage: Object Storage Service (OBS) Database shards cannot serve as the destination.
You can only select an OBS link. obs_link OBS Bucket This parameter is displayed only when Write Dirty Data Link is a link to OBS.
Write Dirty Data: Specify this parameter if data that fails to be processed or filtered out during job execution needs to be written to OBS for future viewing. Before writing dirty data, create an OBS link.
How Do I Use CDM to Export MySQL Data to an SQL File and Upload the File to an OBS Bucket? What Should I Do If CDM Fails to Migrate Data from OBS to DLI?
Use CDM to migrate data from DES to Object Storage Service (OBS). Use CDM to migrate data from OBS to MRS. The operations on CDM are the same as those described in Using CDM to Migrate Data of the Last Month.
Simplified Migration of Trade Data to the Cloud and Analysis Scenario Analysis Process Using CDM to Upload Data to OBS Analyzing Data
Destination Job Parameters To a Relational Database To OBS To HDFS To Hive To HBase/CloudTable To DDS To Elasticsearch/Cloud Search Service To DLI To DIS Parent Topic: Public Data Structures
Log Path Path of the OBS bucket for storing job logs. By default, logs are stored in an OBS bucket named dlf-log-{Projectid}.
Configuring CDM Destination Job Parameters To OBS To HDFS To HBase/CloudTable To Hive To MySQL/SQL Server/PostgreSQL To Oracle To DWS To DDS To Elasticsearch/CSS To DLI To MRS Hudi To MRS ClickHouse To MongoDB To Doris Parent topic: Creating a Job in a CDM Cluster
You can select the OBS link where the list file is located. OBS_test_link OBS Bucket of entries files This parameter is available only when Pull List File is set to Yes.
- OBS storage support The server must support OBS storage. When creating a Hive table, you can store the table in OBS. No AK This parameter is mandatory when OBS storage support is enabled.
Link Parameter Description Link to a Relational Database Link to OBS Link to HDFS Link to HBase Link to CloudTable Link to Hive Link to an FTP or SFTP Server Link to MongoDB Link to Redis Link to Kafka Link to DIS Link to Elasticsearch/Cloud Search Service Link to DLI Link to CloudTable
