检测到您已登录华为云国际站账号,为了您更好的体验,建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
Table 1 Best practices Practice Description Data Import and Export Importing Data from OBS to a Cluster This practice demonstrates how to upload sample data to OBS and import OBS data to the target table on GaussDB(DWS), helping you quickly learn how to import data from OBS to a GaussDB
Importing data from the OBS Upload data to OBS and then export it to GaussDB(DWS) clusters. Data formats such as CSV and TEXT are supported.
Solution: Check whether the settings of GDS, HDFS foreign tables, Roach, and OBS are correct.
The sample data has been uploaded to the traffic-data folder in an OBS bucket, and all Huawei Cloud accounts have been granted the read-only permission for accessing the OBS bucket. Video Tutorial General Procedure This practice takes about 40 minutes.
DDL Syntax DDL Syntax Overview ALTER BLOCK RULE ALTER DATABASE ALTER EXCEPT RULE ALTER EXTERNAL SCHEMA ALTER FOREIGN TABLE (GDS Import and Export) ALTER FOREIGN TABLE (for HDFS or OBS) ALTER FUNCTION ALTER GROUP ALTER INDEX ALTER LARGE OBJECT ALTER MATERIALIZED VIEW ALTER PUBLICATION
OBS configuration OBS must be deployed in three AZs and support parallel file systems. OBS performance If you need to adjust the OBS performance specifications, contact technical support.
OBS Bucket: Name of the OBS bucket for storing script files. If no OBS bucket is available, click View OBS Bucket to access the OBS console and create one. For details, "Managing Buckets" > "Creating a Bucket" in Object Storage Service Console Operation Guide.
This column only applies to OBS 3.0 tables and foreign tables in decoupled storage and compute scenarios. disk_cache_remote_read_size Bigint Total size of data read remotely from OBS due to disk cache read failure, in MB.
This column only applies to OBS 3.0 tables and foreign tables. disk_cache_remote_read_size Bigint Total size of data read remotely from OBS due to disk cache read failure, in MB.
Importing data from the OBS Upload data to OBS and then export it to GaussDB(DWS) clusters. Data formats such as CSV and TEXT are supported.
The default value is off. on indicates that data is encrypted. off indicates that data is not encrypted. access_key Indicates the access key (AK) (obtained by users from the OBS page) used for the OBS access protocol.
Used Capacity of OBS Foreign Tables OBS capacity used by the foreign tables of the default OBS server of the cluster: default_obs_foreign_table_server. NOTE: OBS capacity usage. It is synchronized every four hours.
Examples Delete the foreign table named customer_ft: 1 DROP FOREIGN TABLE customer_ft; Helpful Links ALTER FOREIGN TABLE (GDS Import and Export), ALTER FOREIGN TABLE (for HDFS or OBS), CREATE FOREIGN TABLE (for GDS Import and Export), CREATE FOREIGN TABLE (SQL on OBS or Hadoop) Parent
SQL on Anywhere SQL on Hudi OBS / HDFS / DLI
You are advised to store data files on OBS and use OBS foreign tables to import data. If you want to use COPY to import and export data, perform the following operations: Place the data file on the client. Use gsql to connect to the target cluster.
Exporting Data Exporting Data to OBS Exporting ORC Data to MRS Using GDS to Export Data to a Remote Server
Table 1 Import methods Import Method Data Source Description Advantage Importing Data from OBS in Parallel OBS You can import data in TXT, CSV, ORC, or CarbonData format from OBS to GaussDB(DWS) for query, and can remotely read data from OBS. It is recommended for GaussDB(DWS).
Table 4 Storage media Storage Media Description OBS The created snapshot is an OBS snapshot and the backup data is stored on the OBS server. NFS The created snapshot is an NFS snapshot and the backup data is stored on the NFS server. Table 5 describes the snapshot levels.
You are advised to store data files on OBS and use OBS foreign tables to import data. If you want to use COPY to import and export data, perform the following operations: Place the data file on the client. Use gsql to connect to the target cluster.
You are advised to store data files on OBS and use OBS foreign tables to import data. If you want to use COPY to import and export data, perform the following operations: Place the data file on the client. Use gsql to connect to the target cluster.