检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
Check whether the connection is successful: $SPARK_HOME/bin/run-example org.apache.spark.examples.JavaWordCount obs://obs-bucket/input/test.txt Parent Topic: Connecting OBS to Big Data Components
by ","; insert into table student select 6,"yangdong",29; Parent Topic: Connecting OBS to Big Data Components
/test/ obs://your-bucket/copy-data/ # Download OBS file to local path ma-cli obs-copy obs://your-bucket/copy-data/test.zip ./test.zip # Download OBS directory to local path ma-cli obs-copy obs://your-bucket/copy-data/ .
Refurbishing OBS Function This API is used to refurbish the FunctionGraph OBS trigger for EG subscription.
Interconnecting with OBS Instances Object Storage Service (OBS) is a secure and cost-effective cloud storage service. With OBS, you can easily create, modify, and delete buckets, as well as upload, download, and delete objects.
In a notebook instance, you can call the ModelArts SDK to exchange data with OBS for uploading a file to OBS or downloading a file from OBS to the notebook instance.
Setting up OBS buckets helps in efficiently storing and managing data. Prerequisites The OBS bucket to be exported has been created and the endpoint and the OBS bucket name have been obtained.
Parent topic: OBS Bucket Management
Creating an OBS Table Creating an OBS Table Using the DataSource Syntax Creating an OBS Table Using the Hive Syntax Parent topic: Tables
Querying the Object List in an OBS Bucket Function This interface is used to query objects in an OBS bucket.
Interconnecting with OBS Introduction DIS can upload data to Object Storage Service (OBS). Prerequisites An IAM agency has been created by following the procedure in Creating an IAM Agency. This IAM agency entrusts DIS to access your OBS resources.
To add a self-built OBS bucket or other buckets, ensure that you have enabled OBS and created assets on it. For details about how to enable OBS, see Enabling and Using OBS Buckets.
/presto --server XX.XX.XX.XX:5050 --catalog hive --schema default 1 2 presto:default> select * from sample01; Parent Topic: Connecting OBS to Big Data Components
To delegate CPH to perform operations on OBS buckets, at least the following four actions must be selected: obs:object:GetObject obs:object:PutObject obs:object:PutObjectVersionAcl obs:object:PutObjectAcl Select All for Resources.
To interconnect MRS with OBS using an IAM agency, perform the following tasks: Creating an ECS Agency with OBS Access Permissions Creating a Decoupled Storage and Compute Cluster Creating an OBS File System for Storing Data Creating a Lifecycle Rule Creating an ECS Agency with OBS
Run the hadoop fs -rm obs://<obs_path> command again. Parent topic: Accessing OBS
From OBS If the source link of a job is an OBS link, configure the source job parameters based on Table 1. Advanced attributes are optional and not displayed by default. You can click Show Advanced Attributes to display them.
From OBS If the source link of a job is an OBS link, configure the source job parameters based on Table 1. Advanced attributes are optional and not displayed by default. You can click Show Advanced Attributes to display them.
Figure 3 Selecting a connector type Select Object Storage Service (OBS) and click Next to configure parameters for the OBS link. Name: Enter a custom link name, for example, obslink. OBS Server and Port: Enter the actual OBS address information.
Figure 3 Selecting a connector type Select Object Storage Service (OBS) and click Next to configure parameters for the OBS link. Name: Enter a custom link name, for example, obslink. OBS Server and Port: Enter the actual OBS address information.
