检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
<obs_bucket_name> indicates the OBS bucket name. Only some regions are supported. For details about the supported regions and OBS bucket names, see Supported Regions.
You are advised to store data files on OBS and use OBS foreign tables to import data. If you want to use COPY to import and export data, perform the following operations: Place the data file on the client. Use gsql to connect to the target cluster.
Exporting Data Exporting Data to OBS Exporting ORC Data to MRS Using GDS to Export Data to a Remote Server
Table 1 Import methods Import Method Data Source Description Advantage Importing Data from OBS in Parallel OBS You can import data in TXT, CSV, ORC, or CarbonData format from OBS to GaussDB(DWS) for query, and can remotely read data from OBS. It is recommended for GaussDB(DWS).
Table 4 Storage media Storage Media Description OBS The created snapshot is an OBS snapshot and the backup data is stored on the OBS server. NFS The created snapshot is an NFS snapshot and the backup data is stored on the NFS server. Table 5 describes the snapshot levels.
You are advised to store data files on OBS and use OBS foreign tables to import data. If you want to use COPY to import and export data, perform the following operations: Place the data file on the client. Use gsql to connect to the target cluster.
You are advised to store data files on OBS and use OBS foreign tables to import data. If you want to use COPY to import and export data, perform the following operations: Place the data file on the client. Use gsql to connect to the target cluster.
Data Source Management MRS Data Sources Managing OBS Data Sources Managing LakeFormation Data Sources Parent Topic: Migrating Service Data to a GaussDB(DWS) Cluster
However, if you use more space than the free-of-charge storage space, the exceeded part is charged according to OBS billing rules. For details, see the OBS pricing details.
Verifying data files before and after an import When importing data from OBS, first import your files to your OBS bucket, and then verify that the bucket contains all the correct files, and only those files.
Solution: Check whether the settings of GDS, HDFS foreign tables, Roach, and OBS are correct. GAUSS-01074: "cache lookup failed for foreign server %u" SQLSTATE: XX000 Description: Failed to find the required foreign-data wrapper.
Importing an OBS Data Source 07:01 Data Warehouse Service how to import data in CSV format to a DWS cluster using an OBS foreign table. Importing Data from MRS Data Sources 05:37 Establish an HDFS external table to enable DWS remote access or read MRS Hive data sources.
In the displayed dialog box, set the report retention period and OBS parameters. For details about OBS settings, see Table 2. Parent Topic: Viewing GaussDB(DWS) Cluster Monitoring Information on the Monitoring Panel (DMS)
Importing Data Importing Data from OBS in Parallel Using GDS to Import Data from a Remote Server Importing Data from MRS to a Cluster Importing Data from One GaussDB(DWS) Cluster to Another GDS-based Cross-Cluster Interconnection Using Kettle to Import Data Using a gsql Meta-Command
The hybrid data warehouse (standalone) does 8.2.0.100 and later versions support OBS import and export. GaussDB(DWS) PL/Java Functions GaussDB(DWS) PL/pgSQL Functions
You can create an OBS foreign table to associate two databases in the same data directory for data query.
The GaussDB(DWS) import performance is affected by the following factors: Cluster specifications: disk I/O, network throughput, memory, and CPU specifications Service planning: type of table fields, compress, and row-store or column-store Data storage: local cluster, OBS Data import
The GaussDB(DWS) import performance is affected by the following factors: Cluster specifications: disk I/O, network throughput, memory, and CPU specifications Service planning: type of table fields, compress, and row-store or column-store Data storage: local cluster, OBS Data import
However, if you use more space than the free-of-charge storage space, the exceeded part is charged according to OBS billing rules. For details, see the OBS pricing details.
Data Migration What Are the Differences Between Data Formats Supported by OBS and GDS Foreign Tables in GaussDB(DWS)? How Does GaussDB(DWS) Store Data? How Much Service Data Can Be Stored in GaussDB(DWS)? How to Import and Export Data in GaussDB(DWS) Using \copy?
