检测到您已登录华为云国际站账号,为了您更好的体验,建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
Parent topic: Export to OBS (OBT)
OBS Result Table Function The FileSystem result (sink) table is used to export data to the HDFS or OBS file system. It is applicable to scenarios such as data dumping, big data analysis, data backup, and active, deep, or cold archiving.
Connecting to an OBS Data Source Overview ROMA Connect can use the OBS database as a data source for data integration tasks. Before using the OBS data source, you need to connect it to ROMA Connect.
OBS Link Parameters When connecting CDM to the destination OBS bucket, you need to add the read and write permissions to the destination OBS bucket, and file authentication is not required.
OBS Path Yes Path to the OBS bucket or directory. To create a bucket, enter //OBS bucket name. The OBS bucket name must be unique To create an OBS directory, select the path to the OBS directory to be created, and enter the /Directory name following the path.
Using OBS You can manage OBS resources in the ways listed in the table below. Tool Description How to Use Reference OBS Console OBS Console is a web-based GUI. You can manage all your OBS resources through this console. Create an account or an IAM user to log in to OBS Console.
API Overview of OBS SDK for Go Table 1 describes the APIs provided by OBS SDK for Go. You can click an API name in the table to see its detailed information and sample code.
Naming OBS Objects The OBS object names supported by GES can contain the following characters: Letters and digits 0-9, a-z, A-Z Special characters ! - _ . * ' ( ) The following characters are not supported: Special characters \{^}%`]">[~<#|&@:,$=+?
You can only access OBS using the OBS domain name in the region where the VPC endpoint is located. Configure an OBS route from your on-premises data center to the Direct Connect or VPN gateway. The IP address of OBS belongs to 100.125.0.0/16.
The OBS audit function has been enabled in the asset center. After OBS audit is enabled, you will be charged for reading and writing logs using the logging function of OBS. For details about the fees, see Requests. Sensitive data of OBS assets has been identified.
Automatically Creating an OBS Volume Through kubectl Scenario During the use of OBS, expected OBS buckets can be automatically created and mounted as volumes.
Authorizing Access to an OBS Bucket Function Authorizes VOD to access an OBS bucket or cancels the authorization URI PUT /v1.0/{project_id}/asset/authority Table 1 Path Parameters Parameter Mandatory Type Description project_id Yes String Project ID.
API Overview of OBS SDK for Python Table 1 describes the APIs provided by OBS SDK for Python. You can click an API name in the table to see its detailed information and sample code.
Connecting OBS to Big Data Components Supported Big Data Components Connecting Hadoop to OBS Connecting Hive to OBS Connecting Spark to OBS Connecting Presto to OBS Connecting Flume to OBS Connecting DataX to OBS Connecting Druid to OBS Connecting Flink to OBS Connecting Logstash
Link to OBS Description By creating an OBS link, you can extract files from or load files to Object Storage Service (OBS). Files in CSV, JSON, and binary format are supported. Sample Link The following is the message body of a sample link.
Link to OBS Description By creating an OBS link, you can extract files from or load files to Object Storage Service (OBS). Files in CSV, JSON, and binary format are supported. Sample Link The following is the message body of a sample link.
Interconnecting with OBS Introduction DIS can upload data to Object Storage Service (OBS). Prerequisites An IAM agency has been created by following the procedure in Creating an IAM Agency. This IAM agency entrusts DIS to access your OBS resources.
Compatibility Between OBS APIs and PFS You can call some OBS APIs to use PFS. There may be additional requirements when you call these APIs. For details about the OBS APIs, see Object Storage Service API Reference.
Querying the OBS Capacity Function Query the total, allocated, and available OBS capacities.
OBS and HDFS differ in consistency assurance.