检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
Overview of Offline Jobs Offline processing migration jobs support cross-cluster delivery of data migration jobs to implement batch job migration. Compared with traditional migration jobs that are managed in CDM clusters, offline processing migration jobs are managed in DataArts Factory
What Are the Differences Between Quality Jobs and Comparison Jobs? Possible Causes Differences between quality jobs and comparison jobs Solution You can create quality jobs to apply the created rules to existing tables. Comparison jobs support cross-source data comparison. You can
Scheduling Jobs Across Workspaces Scenario If you have assigned permissions based on workspaces, users in different workspaces can only perform operations on jobs in their own workspaces. However, if jobs in different workspaces depend on each other, you can schedule the jobs across
How Migration Jobs Work Data Migration Model Figure 1 shows the simplified migration model used by CDM. Figure 1 Migration model used by CDM CDM migrates data through data migration jobs. It works in the following way: When data migration jobs are submitted, CDM splits each job into
(Optional) Managing Jobs Copying a Job Copying the Job Name and Renaming a Job Moving a Job or Job Directory Exporting and Importing Jobs Configuring Jobs Deleting a Job Unlocking a Job Viewing a Job Dependency Graph Changing the Job Owner Unlocking Jobs Going to Monitor Job page
Can I Create Jobs in Batches? Symptom Can I create CDM jobs in batches? Solution CDM supports batch job creation with the help of the batch import function. You can create jobs in batches as follows: Create a job manually. Export the job and save the job's JSON file to a local PC.
Can I Schedule Jobs in Batches? Symptom Can I schedule CDM jobs in batches? Solution Yes. Access the DataArts Factory module of the DataArts Studio service. In the navigation pane of the DataArts Factory homepage, choose Data Development > Develop Job to create a job. Drag multiple
DataArts Migration (Real-Time Jobs) Overview How Do I Troubleshoot a Network Disconnection Between the Data Source and Resource Group? Which Ports Must Be Allowed by the Data Source Security Group So That DataArts Migration Can Access the Data Source? How Do I Configure a Spark Periodic
DataArts Migration (CDM Jobs) Overview Notes and Constraints Supported Data Sources Creating and Managing a CDM Cluster Creating a Link in a CDM Cluster Creating a Job in a CDM Cluster Using Macro Variables of Date and Time Improving Migration Performance Key Operation Guide Tutorials
DataArts Migration (Offline Jobs) Overview of Offline Jobs Notes and Constraints Supported Data Sources Check Before Use Enabling Network Connectivity Creating an Offline Processing Migration Job Configuring an Offline Processing Migration Job Configuring Source Job Parameters Configuring
DataArts Migration (Real-Time Jobs) Overview of Real-Time Jobs Notes and Constraints Supported Data Sources Authorizing the Use of Real-Time Data Migration Check Before Use Enabling Network Communications Creating a Real-Time Migration Job Configuring a Real-Time Migration Job Tutorials
Configuring Alarms for Jobs in DataArts Factory of DataArts Studio If a large number of big data jobs are scheduled on DataArts Factory, there may be the following pain points: Job failures may not be found: Most offline big data jobs are executed in the early morning. If a job fails
Can I Synchronize Jobs to Other Clusters? Symptom Can I synchronize jobs to other CDM clusters? Solution CDM does not support direct job migration across clusters. However, you can use the batch job import and export function to indirectly implement cross-cluster migration as follows
Will Subsequent Jobs Be Affected If a Job Fails to Be Executed During Scheduling of Dependent Jobs? What Should I Do? Possible Causes One of the jobs that depend on each other fails during scheduling. Solution The subsequent jobs may be suspended, continued, or canceled, depending
How Do I Back Up CDM Jobs? Symptom How do I back up CDM jobs? Solution You can use the batch export function of CDM to save all job scripts to a local PC. Then, you can create a cluster and import the jobs again when necessary. Parent topic: DataArts Migration (CDM Jobs)
How Do I Configure Notifications for All Jobs? Symptom How to configure notifications for all jobs Solution On the DataArts Studio console, locate a workspace and click DataArts Factory. In the navigation pane on the left, choose Monitoring > Job Monitoring. Then click the Batch Jobs
What Is the Number of Concurrent Jobs for Different CDM Cluster Versions? CDM migrates data through data migration jobs. It works in the following way: When data migration jobs are submitted, CDM splits each job into multiple tasks based on the Concurrent Extractors parameter in the
How Do I View Jobs Associated with a Quality Rule Template? Possible Causes How to view the jobs associated with a quality rule template Solution On the DataArts Studio console, locate an instance and click Access. On the displayed page, locate a workspace and click DataArts Quality
Why Do I Fail to Establish a Dependency Between Two Jobs? Symptom Two jobs are created, but the dependency relationship cannot be established. Cause Analysis Check whether the two jobs' recurrence are both every week or every month. Currently, if the two jobs' recurrence are both
How Do I Check Which Jobs Invoke a CDM Job? Symptom Jobs that invoke a CDM job Solution In the left navigation pane of DataArts Factory, choose Monitoring > Job Monitoring. Click the Batch Job Monitoring tab. Query the scheduling and execution of the CDM job by filter criteria. You
