检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
Parent Topic: Connecting OBS to Big Data Components
/conf/file2obs.conf Parent Topic: Connecting OBS to Big Data Components
Example: txtfilereader is the source, and OBS is the destination.
Where Is Data Stored in OBS? When creating a bucket on OBS, you can specify a region for the bucket. Then your data on OBS is stored on multiple storage devices in this region. Parent topic: OBS Basics
Parent Topic: Connecting Big Data Platforms to OBS
Interconnecting with OBS Instances Object Storage Service (OBS) is a secure and cost-effective cloud storage service. With OBS, you can easily create, modify, and delete buckets, as well as upload, download, and delete objects.
Check whether the connection is successful: $SPARK_HOME/bin/run-example org.apache.spark.examples.JavaWordCount obs://obs-bucket/input/test.txt Parent Topic: Connecting OBS to Big Data Components
Refurbishing OBS Function This API is used to refurbish the FunctionGraph OBS trigger for EG subscription.
by ","; insert into table student select 6,"yangdong",29; Parent Topic: Connecting OBS to Big Data Components
/test/ obs://your-bucket/copy-data/ # Download OBS file to local path ma-cli obs-copy obs://your-bucket/copy-data/test.zip ./test.zip # Download OBS directory to local path ma-cli obs-copy obs://your-bucket/copy-data/ .
In a notebook instance, you can call the ModelArts SDK to exchange data with OBS for uploading a file to OBS or downloading a file from OBS to the notebook instance.
Setting up OBS buckets helps in efficiently storing and managing data. Prerequisites The OBS bucket to be exported has been created and the endpoint and the OBS bucket name have been obtained.
Creating an OBS Table Creating an OBS Table Using the DataSource Syntax Creating an OBS Table Using the Hive Syntax Parent topic: Tables
Parent topic: OBS Bucket Management
To add a self-built OBS bucket or other buckets, ensure that you have enabled OBS and created assets on it. For details about how to enable OBS, see Enabling and Using OBS Buckets.
Interconnecting with OBS Introduction DIS can upload data to Object Storage Service (OBS). Prerequisites An IAM agency has been created by following the procedure in Creating an IAM Agency. This IAM agency entrusts DIS to access your OBS resources.
Querying the Object List in an OBS Bucket Function This interface is used to query objects in an OBS bucket.
/presto --server XX.XX.XX.XX:5050 --catalog hive --schema default 1 2 presto:default> select * from sample01; Parent Topic: Connecting OBS to Big Data Components
To delegate CPH to perform operations on OBS buckets, at least the following four actions must be selected: obs:object:GetObject obs:object:PutObject obs:object:PutObjectVersionAcl obs:object:PutObjectAcl Select All for Resources.
To interconnect MRS with OBS using an IAM agency, perform the following tasks: Creating an ECS Agency with OBS Access Permissions Creating a Decoupled Storage and Compute Cluster Creating an OBS File System for Storing Data Creating a Lifecycle Rule Creating an ECS Agency with OBS
