检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
Scheduling Jobs Across Workspaces Scenario If you have assigned permissions based on workspaces, users in different workspaces can only perform operations on jobs in their own workspaces. However, if jobs in different workspaces depend on each other, you can schedule the jobs across
(Optional) Managing Jobs Copying a Job Copying the Job Name and Renaming a Job Moving a Job or Job Directory Exporting and Importing Jobs Configuring Jobs Deleting a Job Unlocking a Job Viewing a Job Dependency Graph Changing the Job Owner Unlocking Jobs Going to Monitor Job page
DataArts Migration (CDM Jobs) Overview Notes and Constraints Supported Data Sources Creating and Managing a CDM Cluster Creating a Link in a CDM Cluster Creating a Job in a CDM Cluster Using Macro Variables of Date and Time Improving Migration Performance Key Operation Guide Tutorials
DataArts Migration (Offline Jobs) Overview of Offline Jobs Supported Data Sources Creating an Offline Processing Migration Job Configuring an Offline Processing Migration Job Configuring Source Job Parameters Configuring Destination Job Parameters Configuring Field Converters Adding
DataArts Migration (Real-Time Jobs) Overview of Real-Time Jobs Notes and Constraints Supported Data Sources Check Before Use Enabling Network Communications Creating a Real-Time Migration Job Configuring a Real-Time Migration Job Real-Time Migration Job O&M Field Type Mapping Job
DataArts Migration (Real-Time Jobs) Overview How Do I Troubleshoot a Network Disconnection Between the Data Source and Resource Group? Which Ports Must Be Allowed by the Data Source Security Group So That DataArts Migration Can Access the Data Source? How Do I Configure a Spark Periodic
Can I Create Jobs in Batches? Symptom Can I create CDM jobs in batches? Solution CDM supports batch job creation with the help of the batch import function. You can create jobs in batches as follows: Create a job manually. Export the job and save the job's JSON file to a local PC.
Can I Schedule Jobs in Batches? Symptom Can I schedule CDM jobs in batches? Solution Yes. Access the DataArts Factory module of the DataArts Studio service. In the navigation pane of the DataArts Factory homepage, choose Data Development > Develop Job to create a job. Drag multiple
Configuring Alarms for Jobs in DataArts Factory of DataArts Studio If a large number of big data jobs are scheduled on DataArts Factory, there may be the following pain points: Job failures may not be found: Most offline big data jobs are executed in the early morning. If a job fails
Can I Synchronize Jobs to Other Clusters? Symptom Can I synchronize jobs to other CDM clusters? Solution CDM does not support direct job migration across clusters. However, you can use the batch job import and export function to indirectly implement cross-cluster migration as follows
Will Subsequent Jobs Be Affected If a Job Fails to Be Executed During Scheduling of Dependent Jobs? What Should I Do? Possible Causes One of the jobs that depend on each other fails during scheduling. Solution The subsequent jobs may be suspended, continued, or canceled, depending
How Do I Back Up CDM Jobs? Symptom How do I back up CDM jobs? Solution You can use the batch export function of CDM to save all job scripts to a local PC. Then, you can create a cluster and import the jobs again when necessary. Parent topic: DataArts Migration (CDM Jobs)
How Do I Configure Notifications for All Jobs? Symptom How to configure notifications for all jobs Solution On the DataArts Studio console, locate a workspace and click DataArts Factory. In the navigation pane on the left, choose Monitoring > Job Monitoring. Then click the Batch Jobs
What Is the Number of Concurrent Jobs for Different CDM Cluster Versions? CDM migrates data through data migration jobs. It works in the following way: When data migration jobs are submitted, CDM splits each job into multiple tasks based on the Concurrent Extractors parameter in the
How Do I View Jobs Associated with a Quality Rule Template? Possible Causes How to view the jobs associated with a quality rule template Solution On the DataArts Studio console, locate an instance and click Access. On the displayed page, locate a workspace and click DataArts Quality
Why Do I Fail to Establish a Dependency Between Two Jobs? Symptom Two jobs are created, but the dependency relationship cannot be established. Cause Analysis Check whether the two jobs' recurrence are both every week or every month. Currently, if the two jobs' recurrence are both
How Do I Check Which Jobs Invoke a CDM Job? Symptom Jobs that invoke a CDM job Solution In the left navigation pane of DataArts Factory, choose Monitoring > Job Monitoring. Click the Batch Job Monitoring tab. Query the scheduling and execution of the CDM job by filter criteria. You
How Do I Synchronize the Changed Names of CDM Jobs to DataArts Factory? Symptom Updated names of CDM jobs cannot be synchronized to DataArts Factory. Solution After renaming a CDM job, you need to select the renamed CDM job in the CDM node attributes on the DataArts Factory console
How Many Jobs Can Be Created in DataArts Factory? Is There a Limit on the Number of Nodes in a Job? Symptom Whether the number of jobs and the number of nodes in a job are limited during data development Solution By default, each user can create a maximum of 10,000 jobs, and each
How Do I Use Java to Invoke CDM RESTful APIs to Create Data Migration Jobs? CDM provides RESTful APIs to implement automatic job creation or execution control by program invocation. The following describes how to use CDM to migrate data from table city1 in the MySQL database to table
