检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
OBS Indicates that data is restored from OBS. This option is available for MRS 3.3.0-LTS and later versions only.
When using Loader to export data from HDFS or OBS, the input paths and input path subdirectories of the HDFSor OBS data source and the name of the files in these directories do not contain any of the following special characters: /\"':;,.
When using Loader to export data from HDFS or OBS, the input paths and input path subdirectories of the HDFSor OBS data source and the name of the files in these directories do not contain any of the following special characters: /\"':;,.
Impact on the System If the non-heap memory of the Guardian TokenServer instance overflows, OBS cannot be accessed. Possible Causes The non-heap memory of the TokenServer instance is overused or the non-heap memory is inappropriately allocated.
Impact on the System If the heap memory of the Guardian TokenServer instance overflows, OBS cannot be accessed. Possible Causes The heap memory of the TokenServer instance is overused or the heap memory is inappropriately allocated. Handling Procedure Check heap memory usage.
Impact on the System If the direct memory of the Guardian TokenServer instance overflows, OBS cannot be accessed. Possible Causes The direct memory of the TokenServer process is overused or the direct memory is inappropriately allocated.
Impact on the System TokenServer responds slowly, and OBS cannot be accessed. Possible Causes The heap memory of the TokenServer process is overused or inappropriately allocated, causing frequent occurrence of the GC process. Handling Procedure Check the GC duration.
Similar to the example provided in method 1, set Action to Allow and add the outbound rules whose destinations are the address with Secure Communications enabled, NTP server address, OBS server address, OpenStack address, and DNS server address, respectively.
and authentication Web application security Access control Audit security Password security Data security The following measures are provided to ensure the confidentiality, integrity, and availability of massive amounts of user data: Disaster recovery: MRS supports data backup to OBS
Public services, such as Elastic Cloud Server (ECS), Elastic Volume Service (EVS), Object Storage Service (OBS), Virtual Private Cloud (VPC), Elastic IP (EIP), and Image Management Service (IMS), are shared within the same region.
Constraints N/A Value range 0: Do not create an OBS bucket only for log collection when a cluster fails to be created. 1: Create an OBS bucket only for collect logs when a cluster fails to be created.
Hive service data, which is stored in HDFS or OBS You can use the scenario migration function of Huawei Cloud CDM to migrate Hive data with one click. For details about the data sources supported by CDM, see Supported Data Sources.
OBS and HDFS file systems are supported. ADM64 and Arm architectures are supported. Spark SQL mode is supported. Parameters Modify the following parameters in the Client installation directory/Spark/spark/conf/spark-defaults.conf file on the Spark client.
/opt/example/conf:/opt/example/kafka-examples-lib/* com.huawei.bigdata.kafka.example.Producer Observing the Running Result The running result of the JAR file of the sample program project can be viewed in the client.log file in the logs directory.
https://{endpoint}/v2/{project_id}/clusters/{cluster_id}/sql-execution/{sql_id} Example Response Status code: 200 Querying the SQL execution result is successful. { "id" : "20190909_011820_00151_xxxxx", "statement" : "show tables", "status" : "FINISHED", "result_location" : "obs
When OBS is connected in the scenario where storage and compute are decoupled, task-level fault tolerance is supported, but intermediate data is still flushed to the disk of the HDFS temporary directory.
Set this parameter to an OBS bucket path or a local VM path. OBS bucket path: Enter a script path. For example, enter the path of the public sample script provided by MRS. Example: s3a://bootstrap/presto/presto-install.sh.
Impala from Scratch Using Kafka from Scratch Using KafkaManager Using Kudu from Scratch Using Loader from Scratch Using Oozie from Scratch Using OpenTSDB Using Presto Using Ranger Using Spark from Scratch Using Spark2x Using Storm from Scratch Using Tez Using Yarn Using MRS to Access OBS
MRS 2.1.0.8 Patch Description Basic Information Table 1 Basic information Patch Version MRS 2.1.0.8 Release Date 2020-08-04 Resolved Issues List of resolved issues in MRS 2.1.0.8: MRS Manager The problem that the ECS API traffic is limited when OBS is accessed through an agency has
Set this parameter to an OBS bucket path or a local VM path. OBS bucket path: Enter a script path manually, for example, s3a://XXX/scale.sh. Local VM path: Enter a script path. The script path must start with a slash (/) and end with .sh.
