检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
There are the following ways to manage JAR files: Upload packages to OBS: Upload Jar packages to an OBS bucket in advance and select the corresponding OBS path.
Select Save Job Log, and specify the OBS bucket for saving job logs. For details about how to use data types, see Format. Flink 1.15 currently only supports creating OBS tables using Hive syntax, which is supported by Hive dialect DDL statements.
----------------------------------------------------------------------------- tableName:page_views owner:admintest location:obs
Flink Jobs Stream Ecosystem Flink OpenSource SQL Jobs Flink Jar Job Examples Writing Data to OBS Using Flink Jar Using Flink Jar to Connect to Kafka that Uses SASL_SSL Authentication Using Flink Jar to Read and Write Data from and to DIS Flink Job Agencies
For details, see Writing Data to OBS Using Flink Jar. The Flink 1.15 Jar program uses a child-first reverse class loading mechanism.
Currently, data can be exported only to OBS, and the OBS path must be specified to the folder level. The OBS path cannot contain commas (,). The OBS bucket name cannot end with the regular expression format ".[0-9]+(.*)".
You can also specify an OBS path, for example, obs://Bucket name/Package name. files Array of Strings Name of the package that is of the file type and has been uploaded to the DLI resource management system.
Delete this line if it is not required. .withDependencyJars(Arrays.asList("obs://YourObsBucketName/your/dependency1.csv", "obs://YourObsBucketName/your/dependency2.json")) // File uploaded to OBS that stores the dependencies of the user-defined
Request Parameters Table 2 Request body parameters Parameter Mandatory Type Description job_id Yes Long ID of a Flink job savepoint_path Yes String Savepoint path Example: obs://bucket-name/dir Response Parameters Status code: 200 Table 3 Response body parameters Parameter Type Description
Figure 10 Generating a JAR file Log in to the OBS console and upload the file to the OBS path. The region of the OBS bucket to which the Jar package is uploaded must be the same as the region of the DLI queue. Cross-region operations are not allowed.
SQL Job O&M Why Is Error "path obs://xxx already exists" Reported When Data Is Exported to OBS? Why Is Error "SQL_ANALYSIS_ERROR: Reference 't.id' is ambiguous, could be: t.id, t.id.;" Displayed When Two Tables Are Joined?
After obtaining the JAR file of the Spark job code, upload the JAR file to the OBS bucket. In this example, the storage path is obs://dlfexample/spark-examples_2.10-1.1.1.jar. Create an elastic resource pool and create general-purpose queues within it.
Truststore Path OBS path to which the SSL truststore file is uploaded. For MRS Kafka, enter the OBS path of the Truststore.jks file. For DMS Kafka, enter the OBS path of the client.jks file. Truststore Password Truststore password.
Place the keystore.jks file generated in Preparations in the OBS bucket, and then enter the AK, SK, and location of the keystore.jks file.
When using the metadata service provided by DLI, this command does not support OBS paths. System Response You can check whether the job status is successful, and view the job log to confirm whether there is any exception. Parent topic: Hudi DML Syntax
path, for example, obs://Bucket name/Package name. type No String Resource type.
Password The password of the security cluster Certificate Path Enter the OBS path to which the security certificate is uploaded, that is, the OBS bucket address in 2. Figure 1 Creating a datasource authentication-CSS Create a table to access the CSS cluster.
When using the metadata service provided by DLI, this command does not support OBS paths. System Response You can check if the job status is successful, view the job result, and review the job logs to confirm if there are any exceptions. Parent topic: Hudi DML Syntax
When there are both a folder and a file with the same name in the OBS directory, creating an OBS table pointing to that path will prioritize the file over the folder.
] }, { "partition_name": "name=test3", "create_time": 1579522085000, "last_access_time": 1579522085000, "locations": [ "obs://test/partition" ] }
