检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
You are advised to store data files on OBS and use OBS foreign tables to import data. If you want to use COPY to import and export data, perform the following operations: Place the data file on the client. Use gsql to connect to the target cluster.
Data Source Management MRS Data Sources Managing OBS Data Sources Managing LakeFormation Data Sources Parent topic: Migrating Service Data to a GaussDB(DWS) Cluster
However, if you use more space than the free-of-charge storage space, the exceeded part is charged according to OBS billing rules. For details, see the OBS pricing details.
Verifying data files before and after an import When importing data from OBS, first import your files to your OBS bucket, and then verify that the bucket contains all the correct files, and only those files.
Solution: Check whether the settings of GDS, HDFS foreign tables, Roach, and OBS are correct. GAUSS-01074: "cache lookup failed for foreign server %u" SQLSTATE: XX000 Description: Failed to find the required foreign-data wrapper.
Importing Data Importing Data from OBS in Parallel Using GDS to Import Data from a Remote Server Importing Data from MRS to a Cluster Importing Data from One GaussDB(DWS) Cluster to Another GDS-based Cross-Cluster Interconnection Using Kettle to Import Data Using a gsql Meta-Command
The hybrid data warehouse (standalone) does 8.2.0.100 and later versions support OBS import and export. GaussDB(DWS) PL/Java Functions GaussDB(DWS) PL/pgSQL Functions
You can create an OBS foreign table to associate two databases in the same data directory for data query.
The GaussDB(DWS) import performance is affected by the following factors: Cluster specifications: disk I/O, network throughput, memory, and CPU specifications Service planning: type of table fields, compress, and row-store or column-store Data storage: local cluster, OBS Data import
The GaussDB(DWS) import performance is affected by the following factors: Cluster specifications: disk I/O, network throughput, memory, and CPU specifications Service planning: type of table fields, compress, and row-store or column-store Data storage: local cluster, OBS Data import
an OBS foreign table (default server) CREATE FOREIGN TABLE (for OBS Import and Export) Modifying a GDS foreign table ALTER FOREIGN TABLE (GDS Import and Export) HDFS foreign table and OBS foreign table ALTER FOREIGN TABLE (for HDFS or OBS) Deleting a foreign table.
However, if you use more space than the free-of-charge storage space, the exceeded part is charged according to OBS billing rules. For details, see the OBS pricing details.
Data Migration What Are the Differences Between Data Formats Supported by OBS and GDS Foreign Tables in GaussDB(DWS)? How Does GaussDB(DWS) Store Data? How Much Service Data Can Be Stored in GaussDB(DWS)? How to Import and Export Data in GaussDB(DWS) Using \copy?
Import and Export Best Practices for Data Import GDS Practice Guide Transferring Data Between OBS Buckets and GaussDB (DWS) Clusters Using GDS to Import Table Data from a Remote Server to a GaussDB(DWS) Cluster Importing Table Data from MRS Hive to a GaussDB(DWS) Cluster Enabling
SCHEMA.FOREIGN_TABLE indicates the name and schema of the OBS foreign table. LATEST_COMMIT indicates the end time of the Hudi synchronization. Example: Data has been synchronized to the target table public.in_rel from hudi by 20220913152131.
Data Migration What Are the Differences Between Data Formats Supported by OBS and GDS Foreign Tables in GaussDB(DWS)? How Is Data Stored in GaussDB(DWS)? How Much Service Data Can Be Stored in GaussDB(DWS)? How Do I Import and Export Data in GaussDB(DWS) Using \copy?
DWSAccessOBS OBS Administrator Audit log dump: reports audit logs to OBS buckets. DWSAccessKMS KMS Administrator Used to query and rotate keys in a KMS encrypted cluster.
By default, the OBS cold and hot storage is disabled. 29 enable_tsdb_multi_temperature Specifies whether to enable the OBS cold and hot storage for time series tables.
type=OBS Example Response { "data_sources": [ { "id": "8010dbc0-c1d2-48d6-87eb-3229f9195fed", "name": "tes54", "type": "OBS", "connect_info": "gaussdb", "user_name": "DWSAccessOBS", "configure_status
LMT: Switch the hot partition data that is not updated in the last [day] days to the OBS tablespace as cold partition data. [day] is an integer ranging from 0 to 36500, in days.
