检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
OBS / HDFS / DLI GS_138110058 errmsg:Invalid option %s. errhint:alid options in this context are: %s. level:ERROR GS_138110072 errmsg:Need type option for the server. errhint:alid options in this context are: %s. level:ERROR GS_138110073 errmsg:Invalid option %s. errhint:alid options
Transferring Data Between OBS Buckets and GaussDB(DWS) Clusters This guide shows how to upload sample data to OBS and access it through an OBS foreign table. You can import OBS data into GaussDB(DWS) or export data from GaussDB(DWS) to OBS.
About Parallel Data Import from OBS The object storage service (OBS) is an object-based cloud storage service, featuring data storage of high security, proven reliability, and cost-effectiveness. OBS provides large storage capacity for you to store files of any type.
Create an OBS bucket and a folder in the OBS bucket as the directory for storing exported data files. For details, see Planning Data Export. - Create an OBS foreign table. Create a foreign table to help OBS specify information about data files to be exported.
Importing Data from OBS in Parallel About Parallel Data Import from OBS Importing CSV/TXT Data from OBS Importing ORC or CarbonData Data from OBS Parent topic: Importing Data
Querying Data on OBS Through Foreign Tables Viewing Data on OBS by Directly Querying the Foreign Table If the data amount is small, you can directly run SELECT to query the foreign table and view the data on OBS.
Obtaining the OBS Path of Original Data and Setting Read Permission Log in to the OBS management console. Click Service List and choose Object Storage Service to open the OBS management console. Obtain the OBS path for storing source data files.
Managing OBS Data Sources GaussDB(DWS) allows you to access data on OBS by using an agency. You can create a GaussDB(DWS) agency, grant the OBS OperateAccess or OBS Administrator permission to the agency, and bind the agency to an OBS data source you created.
Exporting ORC Data to OBS Planning Data Export Creating a Foreign Server Creating a Foreign Table Exporting Data Parent topic: Exporting Data to OBS
The OBS path in the location parameter is in the format of obs://bucket_name/file_path/ For example, the OBS paths are as follows: 1 2 3 obs://mybucket/input_data/product_info.0 obs://mybucket/input_data/product_info.1 obs://mybucket02/input_data/product_info.2 Grant the OBS bucket
Creating an OBS Foreign Table Procedure Set location of the foreign table based on the path planned in Uploading Data to OBS. Obtain the access keys (AK and SK) to access OBS.
When exporting data from OBS, this parameter cannot be set to true. Use the default value false, indicating that the first row of the exported data file is not the header.
Exporting Data to OBS Parallel OBS Data Export Exporting CSV/TXT Data to OBS Exporting ORC Data to OBS Parent topic: Exporting Data
Parent topic: Importing CSV/TXT Data from OBS
Parent topic: Importing CSV/TXT Data from OBS
Parent topic: Importing ORC or CarbonData Data from OBS
In most cases, OBS data import performance is limited by concurrent network access rate. Therefore, you are advised to deploy multiple buckets on the OBS server to import data in parallel from buckets, better utilizing DN data transfer.
Parent topic: Importing ORC or CarbonData Data from OBS
You can perform 2 in Preparing Data on OBS to obtain the complete OBS path of the data source file. The path is the endpoint of the OBS service. totalrows: This parameter is optional. It does not indicate the total rows of the imported data.
OPTIONS parameters address Specifies the endpoint of the OBS service. Obtain the address as follows: Obtain the OBS path by performing 2 in Preparing Data on OBS. The OBS path displayed on OBS is the endpoint of the OBS service, that is, obs.example.com.
