检测到您已登录华为云国际站账号,为了您更好的体验,建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
What Should I Do If a Shell Script Debugged on an ECS Fails to Be Executed in DataArts Factory? Symptom A shell script that has been debugged on an ECS fails to be executed in DataArts Factory.
FTP/SFTP Link Parameters The FTP/SFTP link is used to migrate files from the on-premises file server or ECS to a database. Only FTP servers running Linux are supported. Do not change the password or user when the job is running.
Please contact ECS Service. [2021/11/17 02:05:56 GMT+0800] [ERROR] Exception message: RuntimeException: Shell script job execute failed. Please contact ECS Service. [2021/11/17 02:05:56 GMT+0800] [ERROR] Root Cause message:RuntimeException: Shell script job execute failed.
However, the Redis set up in the on-premises data center or on the ECS can be the migration source and destination. If the source link of a job is an on-premises Redis link, configure the source job parameters based on Table 1.
You are advised to add the self-mapping of the broker connection address to the /etc/hosts file on the ECS corresponding to the CDM cluster (search for the ECS based on the cluster IP address) so that the client can quickly resolve the broker of the instance.
MongoDB Link Parameters This link is used to transfer data from a third-party cloud MongoDB service or MongoDB created in the on-premises data center or ECS to a big data platform.
For clustered data sources (such as MRS, DWS, RDS, MySQL, Oracle, DIS, and ECS), use two clusters, one for the development environment and the other for the production environment.
If two clusters are used for clustered data sources, such as MRS, GaussDB(DWS), RDS, MySQL, Oracle, DIS, and ECS, you can create data connections in Management Center to distinguish data lake services in the development environment from those in the production environment.
NOTICE: The maximum number of shell or Python scripts that can run concurrently on the ECS is determined by the value of MaxSessions in the /etc/ssh/sshd_config file on the ECS. Set MaxSessions based on the scheduling frequency of shell or Python scripts.
Data Sources Supported for Entire DB Synchronization Entire DB synchronization is used when an on-premises data center or a database created on an ECS needs to be synchronized to a database service or big data service on the cloud.
For clustered data sources (such as MRS, DWS, RDS, MySQL, Oracle, DIS, and ECS), use two clusters, one for the development environment and the other for the production environment.
Preparing the Environment An ECS named ecs-dgc has been created. In this example, the ECS uses the CentOS 8.0 64bit with ARM (40 GB) public image and the Python environment. You can log in to the ECS and run the python command to check the Python environment.
If shell and Python scripts are scheduled frequently, the ECS adds the private IP address of the agent to the blocklist.
memory usage of the physical server accommodating the monitored ECS, which is not accurate as that obtained on the monitored ECS. 0.001% to 90% % N/A Cloud Data Migration 1 minute tomcat_connect Tomcat Concurrent Connections Measures the number of Tomcat concurrent connections on
Prerequisites: An ECS is available. Method: Create a host connection, print the EL expression using echo, and click Test. Then view the log. The value of the EL expression is printed in the log. Use the Create OBS node.
ECS CDM and DataArts DataService clusters of DataArts Studio consist of Elastic Cloud Servers (ECSs). In addition, DataArts Studio can use host connections to connect to ECSs and run Shell or Python scripts.
ECS ecs:servers:list ecs:servers:get ecs:servers:stop ecs:servers:start ecs:cloudServers:list Run the Open/Close Resource job node and create host connections.
ECS CDM Open/Close Resource Yes Possible values: On Off Instance Yes Object to be opened or closed, for example, to open a CDM cluster.
Public services, such as Elastic Cloud Server (ECS), Elastic Volume Service (EVS), Object Storage Service (OBS), Virtual Private Cloud (VPC), Elastic IP (EIP), and Image Management Service (IMS), are shared within the same region.
servers:get", "ecs:servers:list", "ecs:servers:stop", "ecs:servers:start", "ecs:flavors:get", "ecs:cloudServerFlavors:get", "ecs:cloudServers:list", "ecs:availabilityZones:list",