检测到您已登录华为云国际站账号,为了您更好的体验,建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
Available in all regions Using DLI to Submit a SQL Job to Query OBS Data Exporting SQL Job Results dli DLI Spark Job The DLI team has extensively optimized and transformed the open-source Spark to provide batch processing capabilities, while remaining compatible with the Apache Spark
Launched regions: all Sharing Specified Images Replicating a Shared Image Adding Tenants Who Can Use Shared Images Rejecting Accepted Images Stopping Sharing Images FAQs Exporting Images You can export private images to your OBS bucket and download them to your local PC for backup
For a local file, the value is the OBS key. 1.3 from String Message sender ID. Generally, the value is the same as that of Configuration ID of the channel in the AICC. 1.4 mediaType String Message media type.
* 2,3,4,5,6,7", "backup_type": "increment", "backup_level": "cluster", "next_fire_time": "1667213760000", "update_time": "2022-10-31T02:54:54" } ], "device_name": "obs", "server_ips": null, "server_port": null, "backup_param": "" } SDK Sample
Snapshots are stored in the storage space of Object Storage Service (OBS). snapshot restoration A snapshot can be used to restore a cluster to a newly created one that has the same specifications. Currently, you can restore a cluster only to a new one.
You can set the following conditions: Parameter Description Enumeration Value in OBS iOS SDK Copy-Source-if-Match Copies the source object if its ETag is the same as the one specified by this parameter; otherwise, an exception is thrown. cpSrcIfETagMatch Copy-Source-if-None-Match
response.StatusCode); } catch (ObsException ex) { Console.WriteLine("ErrorCode: {0}", ex.ErrorCode); Console.WriteLine("ErrorMessage: {0}", ex.ErrorMessage); } The owner or grantee ID needed in the ACL indicates the account ID, which can be viewed on the My Credentials page of OBS
You can set the following conditions: Parameter Description Property in OBS .NET SDK Copy-Source-If-Modified-Since Copies the source object if it has been modified since the specified time; otherwise, an exception is thrown.
Sample code: // Import the OBS library. var ObsClient = require('./lib/obs'); // Create an instance of ObsClient. var obsClient = new ObsClient({ // Hard-coded or plaintext AK/SK are risky.
64bit.qcow2 file format: qcow2 virtual size: 10G (10737418240 bytes) disk size: 200K cluster_size: 65536 Format specific information: compat: 1.1 lazy refcounts: false Follow-up Procedure After the image file format is converted, you can use obsutil to upload the image file to an OBS
file="obs://your_bucket/your_spark_app.jar", # (Mandatory) Location of the JAR file on OBS. class_name="your_class_fullname", # (Mandatory) Class path of the main class ( --class), for example, org.example.DliCatalogTest.
all_resourcenames Array of strings Resource list. cloud_service_type String Cloud service type. display_id String Display ID. product_id String Product ID. product_spec_desc String Product specifications. resource_name String Resource name. resource_size Integer Number of databases or OBS
Submitting a Spark job Upload the Python code file to the OBS bucket. In the Spark job editor, select the corresponding dependency module and execute the Spark job. After the Spark job is created, click Execute in the upper right corner of the console to submit the job.
Submitting a Spark Job Upload the Python code file to the OBS bucket. In the Spark job editor, select the corresponding dependency module and execute the Spark job. For Spark 2.3.2 (soon to be take offline) or 2.4.5, set Module to sys.datasource.dws when submitting a job.
person')".stripMargin) Insert data. 1 sparkSession.sql("INSERT INTO TABLE person VALUES ('John', 30),('Peter', 45)".stripMargin) Query data. 1 sparkSession.sql("SELECT * FROM person".stripMargin).collect().foreach(println) Submitting a Spark job Upload the Python code file to the OBS
Insert data. 1 sparkSession.sql("insert into test_dds values('3', 'Ann',23)") Query data. 1 sparkSession.sql("select * from test_dds").show() Submitting a Spark job Upload the Python code file to the OBS bucket.
Currently, you can use either of the following methods to fix the vulnerability: Installing the Patch on Existing Cluster Nodes Installing the Patch on New Nodes Prerequisites You have downloaded the patch tool package MRS_Log4j_Patch.tar.gz from the OBS path.
For example, the cloud service type code of OBS is hws.service.type.obs. resource_type_code String Resource type code. For example, the resource type code of VM is hws.resource.type.vm.
For example, the cloud service type code of OBS is hws.service.type.obs. To obtain a specific service type, call the API in Querying Cloud Service Types. service_type_name String A maximum of 200 characters Cloud service type.
For example, the cloud service type code of OBS is hws.service.type.obs. To obtain a specific service type, call the API in Querying Cloud Service Types. resourceType String Resource type code. For example, the VM resource type code of ECS is hws.resource.type.vm.