检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
Parent Topic: Using Cloud Eye to Monitor OBS Buckets
OBS Console Web Browser Compatibility Time Difference Is Longer Than 15 Minutes Between the Client and Server The Object Name Changes After an Object with a Long Name Is Downloaded to a Local Computer An Object Fails to Be Downloaded Using Internet Explorer 11 OBS Console Couldn't
The operations are as follows: Uploading a File to OBS Uploading a Folder to OBS Downloading a File from OBS Downloading a Folder from OBS Parent topic: OBS Management
Accessing OBS Through an NGINX Reverse Proxy Application Scenario Generally, you can access OBS using a bucket's access domain name (for example, https://bucketname.obs.ap-southeast-1.myhuaweicloud.com) provided by OBS or using a user-defined domain name bound to an OBS bucket.
Accessing OBS Using HetuEngine Through Guardian After Guardian is interconnected with OBS by referring to Disabling Ranger OBS Path Authentication for Guardian or Enabling Ranger OBS Path Authentication for Guardian, you can create a table with a specified location as the OBS file
Accessing OBS Using Flink Through Guardian After Guardian is interconnected with OBS by referring to Disabling Ranger OBS Path Authentication for Guardian or Enabling Ranger OBS Path Authentication for Guardian, you can access the OBS parallel file system and run jobs in a Flink job
Accessing OBS Using Spark Through Guardian After Guardian is interconnected with OBS by referring to Disabling Ranger OBS Path Authentication for Guardian or Enabling Ranger OBS Path Authentication for Guardian, you can create a table whose location is the OBS path on the Spark client
Accessing OBS Using MapReduce Through Guardian After Guardian is interconnected with OBS by referring to Disabling Ranger OBS Path Authentication for Guardian or Enabling Ranger OBS Path Authentication for Guardian, you need to add custom configurations for the MapReduce component
Access the OBS file system. hdfs dfs -ls obs://OBS parallel file system name/path Create a directory in the OBS file system. hdfs dfs -mkdir obs://OBS parallel file system name/hadoop Upload the /opt/test.txt file on the client node to the obs://OBS parallel file system name/hadoop
Access the OBS file system. hdfs dfs -ls obs://OBS parallel file system name/path Create a directory in the OBS file system. hdfs dfs -mkdir obs://OBS parallel file system name/hadoop1 Execute the YARN task to access OBS. yarn jar Client installation directory/HDFS/hadoop/share/hadoop
Accessing OBS Using Hive Through Guardian After Guardian is interconnected with OBS by referring to Disabling Ranger OBS Path Authentication for Guardian or Enabling Ranger OBS Path Authentication for Guardian, you can create tables stored in the OBS parallel file system on the Hive
Accessing OBS Using Hudi Through Guardian After Guardian is interconnected with OBS by referring to Disabling Ranger OBS Path Authentication for Guardian or Enabling Ranger OBS Path Authentication for Guardian, you can create a Hudi COW table in spark-shell and store it to OBS.
Parent topic: Export to OBS
OBS Events Huawei Cloud functions can be triggered by different event sources, which can be defined and configured through events. OBS Events In this example, an OBS event is set.
Parent topic: Export to OBS
Parent topic: Export to OBS
To OBS If the destination link of a job is an OBS link, that is, data is to be imported to OBS, configure the destination job parameters based on Table 1. Advanced attributes are optional and not displayed by default. You can click Show Advanced Attributes to display them.
To OBS If the destination link of a job is an OBS link, that is, data is to be imported to OBS, configure the destination job parameters based on Table 1. Advanced attributes are optional and not displayed by default. You can click Show Advanced Attributes to display them.
Table 1 OBS resources and their paths Resource Type Resource Name Path Buckets Bucket [Format] obs:*:*:bucket:Bucket name [Notes] IAM automatically generates the prefix obs:*:*:bucket: for bucket resource paths.
Create an OBS bucket and a folder in the OBS bucket as the directory for storing exported data files. For details, see Planning Data Export. - Create an OBS foreign table. Create a foreign table to help OBS specify information about data files to be exported.
