检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
Click the name of the corresponding Flink job, choose Run Log, click OBS Bucket, and locate the folder of the log you want to view according to the date. Go to the folder of the date, find the folder whose name contains taskmanager, download the .out file, and view result logs.
Method 2: If you allow DLI to save job logs in OBS, view the output in the taskmanager.out file. +I(111,scooter,Big 2-wheel scooter,5.15) Parent topic: Format
Click the name of the corresponding Flink job, choose Run Log, click OBS Bucket, and locate the folder of the log you want to view according to the date. Go to the folder of the date, find the folder whose name contains taskmanager, download the .out file, and view result logs.
Before writing dirty data, create an OBS link. You can view the data on OBS later. Retain the default value No, meaning dirty data is not recorded. Click Save and Run. On the Job Management page, you can view the job execution progress and result.
Before writing dirty data, create an OBS link. You can view the data on OBS later. Retain the default value No, meaning dirty data is not recorded. Click Save and Run. On the Job Management page, you can view the job execution progress and result.
For more logs, check the OBS bucket where the job logs are stored. Search for dependency information in the logs. Search for Classpath: in the logs to check the dependencies.
Select Save Job Log, and specify the OBS bucket for saving job logs.
Select Save Job Log, and specify the OBS bucket for saving job logs. Change the values of the parameters in bold as needed in the following script.
Precautions When a sub-account uses the TPC-H test suite, the main account needs to grant the sub-account the OBS access permission and the permission to view the main account table.
Insert data. 1 sparkSession.sql("insert into dli_to_rds values (1,'John',24)"); Query data. 1 sparkSession.sql("select * from dli_to_rd").show(); Response Submitting a Spark job Generate a JAR file based on the code file and upload the JAR file to the OBS bucket.
Method 2: If you allow DLI to save job logs in OBS, view the output in the taskmanager.out file.
Method 2: If you allow DLI to save job logs in OBS, view the output in the taskmanager.out file. -U(111,scooter,Big2-wheel scooter,5.18) +U(111,scooter,Big2-wheel scooter,5.15) Parent topic: Format
Click the name of the corresponding Flink job, choose Run Log, click OBS Bucket, and locate the folder of the log you want to view according to the date. Go to the folder of the date, find the folder whose name contains taskmanager, download the .out file, and view result logs.
Select Save Job Log, and specify the OBS bucket for saving job logs.
Create a Kafka cluster for DMS, enable SASL_SSL, download the SSL certificate, and upload the downloaded certificate client.jks to an OBS bucket.
Before writing dirty data, create an OBS link. You can view the data on OBS later. Retain the default value No, meaning dirty data is not recorded. Click Save and Run. On the Job Management page, you can view the job execution progress and result.
If it is set to false, only metadata is cleared and data files are moved to the OBS recycle bin. The default value is false. You are advised not to change the value. Otherwise, deleted data cannot be restored.
Default value: false obs_bucket No String OBS bucket where users are authorized to save logs when log_enabled is set to true. smn_topic No String SMN topic.
Method 2: If you allow DLI to save job logs in OBS, view the output in the taskmanager.out file. -U(111,scooter,Big2-wheel scooter,5.15) +U(111,scooter,Big2-wheel scooter,5.18) Parent topic: Format
OBS Bucket: Select an OBS bucket for storing job logs and grant access permissions of the OBS bucket as prompted. Enable Checkpointing: Enable this function. Enter a SQL statement in the editing pane. The following is an example. Modify the parameters in bold as you need.
