检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
Data Source Management MRS Data Sources Managing OBS Data Sources Managing LakeFormation Data Sources Parent Topic: Migrating Service Data to a GaussDB(DWS) Cluster
However, if you use more space than the free-of-charge storage space, the exceeded part is charged according to OBS billing rules. For details, see the OBS Pricing Details.
Verifying data files before and after an import When importing data from OBS, first import your files to your OBS bucket, and then verify that the bucket contains all the correct files, and only those files.
In the displayed dialog box, set the report retention period and OBS parameters. For details about OBS settings, see Table 2. Parent Topic: Viewing GaussDB(DWS) Cluster Monitoring Information on the Monitoring Panel (DMS)
Solution: Check whether the settings of GDS, HDFS foreign tables, Roach, and OBS are correct. GAUSS-01074: "cache lookup failed for foreign server %u" SQLSTATE: XX000 Description: Failed to find the required foreign-data wrapper.
Importing an OBS Data Source 07:01 Data Warehouse Service how to import data in CSV format to a DWS cluster using an OBS foreign table. Importing Data from MRS Data Sources 05:37 Establish an HDFS external table to enable DWS remote access or read MRS Hive data sources.
Importing Data Importing Data from OBS in Parallel Using GDS to Import Data from a Remote Server Importing Data from MRS to a Cluster Importing Data from One GaussDB(DWS) Cluster to Another GDS-based Cross-Cluster Interconnection Using Kettle to Import Data Using a gsql Meta-Command
The hybrid data warehouse (standalone) does 8.2.0.100 and later versions support OBS import and export. GaussDB(DWS) PL/Java Functions GaussDB(DWS) PL/pgSQL Functions
Transferring Data Between OBS Buckets and GaussDB(DWS) Clusters Describes how to upload sample data to OBS, access data in OBS buckets using OBS foreign tables, import data to GaussDB(DWS), or export data from a GaussDB(DWS) table to an OBS bucket.
The GaussDB(DWS) import performance is affected by the following factors: Cluster specifications: disk I/O, network throughput, memory, and CPU specifications Service planning: type of table fields, compress, and row-store or column-store Data storage: local cluster, OBS Data import
The GaussDB(DWS) import performance is affected by the following factors: Cluster specifications: disk I/O, network throughput, memory, and CPU specifications Service planning: type of table fields, compress, and row-store or column-store Data storage: local cluster, OBS Data import
Import and Export Importing Data to GaussDB(DWS) Transferring Data Between OBS Buckets and GaussDB(DWS) Clusters Using GDS to Import Table Data from a Remote Server to a GaussDB(DWS) Cluster Importing Table Data from MRS Hive to a GaussDB(DWS) Cluster Enabling Cross-Cluster Access
NOTE: It is the hot storage (including cache) displayed on the cluster details page after a cluster is created, different from OBS storage. Cold storage Cold partition data is stored in OBS, which is cost-effective and billed on a pay-per-use basis.
Data Migration What Are the Differences Between Data Formats Supported by OBS and GDS Foreign Tables in GaussDB(DWS)? How Does GaussDB(DWS) Store Data? How Much Service Data Can Be Stored in GaussDB(DWS)? How to Import and Export Data in GaussDB(DWS) Using \copy?
Data Migration What Are the Differences Between Data Formats Supported by OBS and GDS Foreign Tables in GaussDB(DWS)? How Is Data Stored in GaussDB(DWS)? How Much Service Data Can Be Stored in GaussDB(DWS)? How Do I Import and Export Data in GaussDB(DWS) Using \copy?
SCHEMA.FOREIGN_TABLE indicates the name and schema of the OBS foreign table. LATEST_COMMIT indicates the end time of the Hudi synchronization. Example: Data has been synchronized to the target table public.in_rel from hudi by 20220913152131.
Data Migration What Are the Differences Between Data Formats Supported by OBS and GDS Foreign Tables in GaussDB(DWS)? How Is Data Stored in GaussDB(DWS)? How Much Service Data Can Be Stored in GaussDB(DWS)? How Do I Import and Export Data in GaussDB(DWS) Using \copy?
DWSAccessOBS OBS Administrator Audit log dump: reports audit logs to OBS buckets. DWSAccessKMS KMS Administrator Used to query and rotate keys in a KMS encrypted cluster.
By default, the OBS cold and hot storage is disabled. 29 enable_tsdb_multi_temperature Specifies whether to enable the OBS cold and hot storage for time series tables.
type=OBS Example Response { "data_sources": [ { "id": "8010dbc0-c1d2-48d6-87eb-3229f9195fed", "name": "tes54", "type": "OBS", "connect_info": "gaussdb", "user_name": "DWSAccessOBS", "configure_status
