检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
Flink Jobs Stream Ecosystem Flink OpenSource SQL Jobs Flink Jar Job Examples Writing Data to OBS Using Flink Jar Using Flink Jar to Connect to Kafka that Uses SASL_SSL Authentication Using Flink Jar to Read and Write Data from and to DIS Flink Job Agencies
For details, see Writing Data to OBS Using Flink Jar. The Flink 1.15 Jar program uses a child-first reverse class loading mechanism.
Currently, data can be exported only to OBS, and the OBS path must be specified to the folder level. The OBS path cannot contain commas (,). The OBS bucket name cannot end with the regular expression format ".[0-9]+(.*)".
You can also specify an OBS path, for example, obs://Bucket name/Package name. files Array of Strings Name of the package that is of the file type and has been uploaded to the DLI resource management system.
Delete this line if it is not required. .withDependencyJars(Arrays.asList("obs://YourObsBucketName/your/dependency1.csv", "obs://YourObsBucketName/your/dependency2.json")) // File uploaded to OBS that stores the dependencies of the user-defined
CSV Storage Path Enter or select an OBS path. The path can be a folder or a path. NOTE: If you need to import data stored in OBS to the OBS table, set this parameter to the path of a folder.
Request Parameters Table 2 Request body parameters Parameter Mandatory Type Description job_id Yes Long ID of a Flink job savepoint_path Yes String Savepoint path Example: obs://bucket-name/dir Response Parameters Status code: 200 Table 3 Response body parameters Parameter Type Description
Figure 10 Generating a JAR file Log in to the OBS console and upload the file to the OBS path. The region of the OBS bucket to which the Jar package is uploaded must be the same as the region of the DLI queue. Cross-region operations are not allowed.
SQL Job O&M Why Is Error "path obs://xxx already exists" Reported When Data Is Exported to OBS? Why Is Error "SQL_ANALYSIS_ERROR: Reference 't.id' is ambiguous, could be: t.id, t.id.;" Displayed When Two Tables Are Joined?
Truststore Path OBS path to which the SSL truststore file is uploaded. For MRS Kafka, enter the OBS path of the Truststore.jks file. For DMS Kafka, enter the OBS path of the client.jks file. Truststore Password Truststore password.
Place the keystore.jks file generated in Preparations in the OBS bucket, and then enter the AK, SK, and location of the keystore.jks file.
When using the metadata service provided by DLI, this command does not support OBS paths. System Response You can check whether the job status is successful, and view the job log to confirm whether there is any exception. Parent topic: Hudi DML Syntax
path, for example, obs://Bucket name/Package name. type No String Resource type.
Password The password of the security cluster Certificate Path Enter the OBS path to which the security certificate is uploaded, that is, the OBS bucket address in 2. Figure 1 Creating a datasource authentication-CSS Create a table to access the CSS cluster.
When using the metadata service provided by DLI, this command does not support OBS paths. System Response You can check if the job status is successful, view the job result, and review the job logs to confirm if there are any exceptions. Parent topic: Hudi DML Syntax
] }, { "partition_name": "name=test3", "create_time": 1579522085000, "last_access_time": 1579522085000, "locations": [ "obs://test/partition" ] }
`obs://bucket_name/db0/delta_table0` VERSION AS OF 2; Parent topic: Delta Time Travel
If this option is selected, you need to set the following parameters: OBS Bucket: Select an OBS bucket to store user job logs. If the selected OBS bucket is not authorized, click Authorize.
Request Table 2 Request parameters Parameter Mandatory Type Description paths Yes Array of Strings List of OBS object paths. The OBS object path refers to the OBS object URL. group Yes String Name of a package group.
Request Table 2 Request parameters Parameter Mandatory Type Description paths Yes Array of strings List of OBS object paths. The OBS object path refers to the OBS object URL. group Yes String Name of a package group.
