检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
Set this parameter to an OBS bucket path or a local VM path. OBS bucket path: Enter a script path. For example, enter the path of the public sample script provided by MRS. Example: s3a://bootstrap/presto/presto-install.sh.
Set this parameter to an OBS bucket path or a local VM path. OBS bucket path: Enter a script path manually. For example, enter the path of the public sample script provided by MRS. Example: s3a://bootstrap/presto/presto-install.sh.
-Dmapreduce.job.hdfs-servers If OBS is connected, but the server still uses HDFS, you need to explicitly use this parameter in the command line to specify the HDFS address. The format is hdfs://{NAMESERVICE}. Replace NAMESERVICE with the HDFS NameService name.
-Dmapreduce.job.hdfs-servers If OBS is connected, but the server still uses HDFS, you need to explicitly use this parameter in the command line to specify the HDFS address. The format is hdfs://{NAMESERVICE}. Replace NAMESERVICE with the HDFS NameService name.
-Dmapreduce.job.hdfs-servers If OBS is connected, but the server still uses HDFS, you need to explicitly use this parameter in the command line to specify the HDFS address. The format is hdfs://{NAMESERVICE}. Replace NAMESERVICE with the HDFS NameService name.
-Dmapreduce.job.hdfs-servers If OBS is connected, but the server still uses HDFS, you need to explicitly use this parameter in the command line to specify the HDFS address. The format is hdfs://{NAMESERVICE}. Replace NAMESERVICE with the HDFS NameService name.
If the Hive table is stored on OBS, you can use the URL policy within the Ranger policy. Set the URL to the complete path of the object on OBS. The read and write permissions are used together with the URL. URL policies are not involved in other scenarios.
Parameter Default Open Source Port Default Custom Port Port Description ranger.obs.service.rpc.address.port 26901 26901 The RPC listening port for the Guardian OBS client service. token.server.http-server.port 26900 26900 HTTP listening port of the Guardian service. token.server.rpc.address.port
Flink Jobs Development Rules Development Suggestions Parent topic: Flink
Managing Jobs Migrating Loader Jobs in Batches Deleting Loader Jobs in Batches Importing Loader Jobs in Batches Exporting Loader Jobs in Batches Viewing Historical Job Information Parent topic: Using Loader
Deleting Jobs in Batches Function This API is used to delete jobs in batches. Constraints None Debugging You can debug this API in API Explorer. Automatic authentication is supported. API Explorer can automatically generate sample SDK code and provide the sample SDK code debugging
Querying a List of Jobs Function This API is used to query jobs submitted on the job management page in a specified MRS cluster. Constraints None Debugging You can debug this API in API Explorer. Automatic authentication is supported. API Explorer can automatically generate sample
Managing FlinkServer Jobs Configuring the FlinkServer Job Restart Policy Using UDFs in FlinkServer Jobs Parent topic: Using Flink
Managing FlinkServer Jobs Viewing the Health Status of FlinkServer Jobs Importing and Exporting FlinkServer Job Information Configuring Automatic Clearing of FlinkServer Job Residuals Configuring the FlinkServer Job Restart Policy Adding Third-Party Dependency JAR Packages to a FlinkServer
Managing Loader Jobs Migrating Loader Jobs in Batches Deleting Loader Jobs in Batches Importing Loader Jobs in Batches Exporting Loader Jobs in Batches Viewing Historical Information About a Loader Job Purging Historical Loader Data Managing Loader Links Parent topic: Using Loader
Migrating Loader Jobs in Batches Scenario Loader allows jobs to be migrated in batches from a group (source group) to another group (target group). This section applies to MRS 3.x or later. Prerequisites The source group and target group exist. The current user has the Group Edit
Deleting Loader Jobs in Batches Scenario Loader allows existing jobs to be deleted in batches. This section applies to MRS 3.x or later. Prerequisites The current user has the Edit permission for the jobs to be deleted or the Jobs Edit permission for the group to which the jobs belong
Importing Loader Jobs in Batches Scenario Loader allows all jobs of a configuration file to be imported in batches. This section applies to MRS 3.x or later. Prerequisites The current user has the Jobs Edit permission of the group to which the jobs to be imported belong. If the group
Exporting Loader Jobs in Batches Scenario Loader allows existing jobs to be exported in batches. This section applies to MRS 3.x or later. Prerequisites The current user has the Edit permission for the jobs to be exported or the Jobs Edit permission of the group to which the jobs
Using UDFs in FlinkServer Jobs This section applies to MRS 3.1.2 or later. You can customize functions to extend SQL statements to meet personalized requirements. These functions are called user-defined functions (UDFs). You can upload and manage UDF JAR files on the Flink web UI
