检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
OBS Indicates that data is restored from OBS. This option is available for MRS 3.3.0-LTS.1 and later versions only.
OBS: indicates that backup files are stored in OBS.
OBS Path: Find the info.txt file in the created OBS parallel file system and click Yes. HDFS Path: Select an HDFS path, for example, /tmp/test, and click Yes. Click OK and wait until the data file is imported.
Public services such as Elastic Cloud Server (ECS), Elastic Volume Service (EVS), Object Storage Service (OBS), Virtual Private Cloud (VPC), Elastic IP (EIP), and Image Management Service (IMS) are shared within the same region.
Table 1 MRS console and Manager capability comparison Operation Console Manager Changing subnets, adding security group rules, controlling OBS permissions, managing agencies, and synchronizing IAM users Yes No Adding node groups, scaling out, scaling in, and upgrading specifications
After a job is executed, the system will compress and save the logs to the corresponding path if you choose to save job logs to OBS or HDFS. Therefore, after a job execution of this type is completed, the job status is still Running.
OBS Indicates that data is restored from OBS. This option is available for MRS 3.3.0-LTS and later versions only.
When using Loader to export data from HDFS or OBS, the input paths and input path subdirectories of the HDFSor OBS data source and the name of the files in these directories do not contain any of the following special characters: /\"':;,.
When using Loader to export data from HDFS or OBS, the input paths and input path subdirectories of the HDFSor OBS data source and the name of the files in these directories do not contain any of the following special characters: /\"':;,.
You can select an HDFS or OBS path. - Output Data Path Data output path. You can select an HDFS or OBS path. - Job Status Polling Interval (s) Interval for querying job running status.
Impact on the System If the heap memory of the Guardian TokenServer instance overflows, OBS cannot be accessed. Possible Causes The heap memory of the TokenServer instance is overused or the heap memory is inappropriately allocated. Handling Procedure Check heap memory usage.
Impact on the System If the direct memory of the Guardian TokenServer instance overflows, OBS cannot be accessed. Possible Causes The direct memory of the TokenServer process is overused or the direct memory is inappropriately allocated.
Impact on the System If the non-heap memory of the Guardian TokenServer instance overflows, OBS cannot be accessed. Possible Causes The non-heap memory of the TokenServer instance is overused or the non-heap memory is inappropriately allocated.
Impact on the System TokenServer responds slowly, and OBS cannot be accessed. Possible Causes The heap memory of the TokenServer process is overused or inappropriately allocated, causing frequent occurrence of the GC process. Handling Procedure Check the GC duration.
Why Do I Fail to Create a Table in the Specified Location on OBS After Logging to Spark Beeline? Spark Shuffle Exception Handling Why Does the Cluster Port Fail to Connect When a Client Outside the Cluster Is Installed or Used?
Offline data lake: collects and processes offline data from service systems, processes wide tables, uses HDFS or OBS for data storage, and uses Spark SQL as the data processing engine.
Public services, such as Elastic Cloud Server (ECS), Elastic Volume Service (EVS), Object Storage Service (OBS), Virtual Private Cloud (VPC), Elastic IP (EIP), and Image Management Service (IMS), are shared within the same region.
and authentication Web application security Access control Audit security Password security Data security The following measures are provided to ensure the confidentiality, integrity, and availability of massive amounts of user data: Disaster recovery: MRS supports data backup to OBS
Constraints N/A Value range 0: Do not create an OBS bucket only for log collection when a cluster fails to be created. 1: Create an OBS bucket only for collect logs when a cluster fails to be created.
/opt/example/conf:/opt/example/kafka-examples-lib/* com.huawei.bigdata.kafka.example.Producer Observing the Running Result The running result of the JAR file of the sample program project can be viewed in the client.log file in the logs directory.
