检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
Error Occurred When Pandas Reads Data from an OBS File If MoXing Is Used to Adapt to an OBS Path Symptom If MoXing is used to adapt to an OBS path, an error occurs when pandas of a later version reads data from an OBS file. 1. 'can't decode byte xxx in position xxx' 2.
OBS Result Table Function The FileSystem result (sink) table is used to export data to the HDFS or OBS file system. It is applicable to scenarios such as data dumping, big data analysis, data backup, and active, deep, or cold archiving.
The node to which the storage is mounted must be able to access OBS buckets. Generally, the Internet or Direct Connect is used to access OBS buckets across regions. You can ping the endpoint of OBS on the node where OBS is located to check whether OBS is accessible.
OBS Link Parameters When connecting CDM to the destination OBS bucket, you need to add the read and write permissions to the destination OBS bucket, and file authentication is not required.
OBS Path Yes Path to the OBS bucket or directory. To create a bucket, enter //OBS bucket name. The OBS bucket name must be unique To create an OBS directory, select the path to the OBS directory to be created, and enter the /Directory name following the path.
Naming OBS Objects The OBS object names supported by GES can contain the following characters: Letters and digits 0-9, a-z, A-Z Special characters ! - _ . * ' ( ) The following characters are not supported: Special characters \{^}%`]">[~<#|&@:,$=+?
Using OBS You can manage OBS resources in the ways listed in the table below. Tool Description How to Use Reference OBS Console OBS Console is a web-based GUI where you can manage your OBS resources with ease. Create an account or an IAM user to log in to OBS Console.
You can only access OBS using the OBS domain name in the region where the VPC endpoint is located. Configure an OBS route from your on-premises data center to the Direct Connect or VPN gateway. The IP address of OBS belongs to 100.125.0.0/16.
Connecting to an OBS Data Source Overview ROMA Connect can use the OBS database as a data source for data integration tasks. Before using the OBS data source, you need to connect it to ROMA Connect.
API Overview of OBS SDK for Go Table 1 describes the APIs provided by OBS SDK for Go. You can click an API name in the table to see its detailed information and sample code.
Link to OBS Description By creating an OBS link, you can extract files from or load files to Object Storage Service (OBS). Files in CSV, JSON, and binary format are supported. Sample Link The following is the message body of a sample link.
Link to OBS Description By creating an OBS link, you can extract files from or load files to Object Storage Service (OBS). Files in CSV, JSON, and binary format are supported. Sample Link The following is the message body of a sample link.
To add a self-built OBS bucket or other buckets, ensure that you have enabled OBS and created assets on it. For details about how to enable OBS, see Enabling and Using OBS Buckets.
Automatically Creating an OBS Volume Through kubectl Scenario During the use of OBS, expected OBS buckets can be automatically created and mounted as volumes.
Authorizing Access to an OBS Bucket Function Authorizes VOD to access an OBS bucket or cancels the authorization URI PUT /v1.0/{project_id}/asset/authority Table 1 Path Parameters Parameter Mandatory Type Description project_id Yes String Project ID.
API Overview of OBS SDK for Python Table 1 describes the APIs provided by OBS SDK for Python. You can click an API name in the table to see its detailed information and sample code.
Interconnecting with OBS Introduction DIS can upload data to Object Storage Service (OBS). Prerequisites An IAM agency has been created by following the procedure in Creating an IAM Agency. This IAM agency entrusts DIS to access your OBS resources.
Querying the OBS Capacity Function Query the total, allocated, and available OBS capacities.
Connecting OBS to Big Data Components Supported Big Data Components Connecting Hadoop to OBS Connecting Hive to OBS Connecting Spark to OBS Connecting Presto to OBS Connecting Flume to OBS Connecting DataX to OBS Connecting Druid to OBS Connecting Flink to OBS Connecting Logstash
Interconnecting with OBS Instances Object Storage Service (OBS) is a secure and cost-effective cloud storage service. With OBS, you can easily create, modify, and delete buckets, as well as upload, download, and delete objects.
