检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
Interconnecting with OBS Instances Object Storage Service (OBS) is a secure and cost-effective cloud storage service. With OBS, you can easily create, modify, and delete buckets, as well as upload, download, and delete objects.
Compatibility Between OBS APIs and PFS You can call some OBS APIs to use PFS. There may be additional requirements when you call these APIs. For details about the OBS APIs, see Object Storage Service API Reference.
OBS and HDFS differ in consistency assurance.
Parent Topic: Connecting OBS to Big Data Components
/conf/file2obs.conf Parent Topic: Connecting OBS to Big Data Components
Example: txtfilereader is the source, and OBS is the destination.
Where Is Data Stored in OBS? When creating a bucket on OBS, you can specify a region for the bucket. Then your data on OBS is stored on multiple storage devices in this region. Parent topic: OBS Basics
Creating an OBS Table Creating an OBS Table Using the DataSource Syntax Creating an OBS Table Using the Hive Syntax Parent topic: Tables
Parent Topic: Connecting Big Data Platforms to OBS
/test/ obs://your-bucket/copy-data/ # Download OBS file to local path ma-cli obs-copy obs://your-bucket/copy-data/test.zip ./test.zip # Download OBS directory to local path ma-cli obs-copy obs://your-bucket/copy-data/ .
Check whether the connection is successful: $SPARK_HOME/bin/run-example org.apache.spark.examples.JavaWordCount obs://obs-bucket/input/test.txt Parent Topic: Connecting OBS to Big Data Components
by ","; insert into table student select 6,"yangdong",29; Parent Topic: Connecting OBS to Big Data Components
Interconnecting with OBS Introduction DIS can upload data to Object Storage Service (OBS). Prerequisites An IAM agency has been created by following the procedure in Creating an IAM Agency. This IAM agency entrusts DIS to access your OBS resources.
Setting up OBS buckets helps in efficiently storing and managing data. Prerequisites The OBS bucket to be exported has been created and the endpoint and the OBS bucket name have been obtained.
In a notebook instance, you can call the ModelArts SDK to exchange data with OBS for uploading a file to OBS or downloading a file from OBS to the notebook instance.
Parent topic: OBS Bucket Management
Querying the Object List in an OBS Bucket Function This interface is used to query objects in an OBS bucket.
Creating an OBS Source Bucket and a Target Bucket Log in to the OBS console. Click Create Bucket. Set bucket parameters. For details about these parameters, see Creating a Bucket. Table 1 Bucket parameters Parameter Description Region Select the region of your EG service.
To delegate CPH to perform operations on OBS buckets, at least the following four actions must be selected: obs:object:GetObject obs:object:PutObject obs:object:PutObjectVersionAcl obs:object:PutObjectAcl Select All for Resources.
/presto --server XX.XX.XX.XX:5050 --catalog hive --schema default 1 2 presto:default> select * from sample01; Parent Topic: Connecting OBS to Big Data Components
