检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
To query information about OBS/GDS foreign tables such as OBS paths, run the following statement: 1 SELECT * FROM pg_get_tabledef ('foreign_table_name') The following uses table traffic_data.GCJL_OBS as an example: 1 SELECT * FROM pg_get_tabledef('traffic_data.GCJL_OBS'); Parent
To query information about OBS/GDS foreign tables such as OBS paths, run the following statement: 1 SELECT * FROM pg_get_tabledef ('foreign_table_name') The following uses table traffic_data.GCJL_OBS as an example: 1 SELECT * FROM pg_get_tabledef('traffic_data.GCJL_OBS'); Parent
GaussDB(DWS) accesses Hudi data on OBS through foreign tables. For details, see section CREATE FOREIGN TABLE (SQL on OBS or Hadoop). Compared with OBS foreign tables, you only need to set format to hudi for Hudi foreign tables.
PG_OBSSCANINFO PG_OBSSCANINFO defines the OBS runtime information scanned in cluster acceleration scenarios. Each record corresponds to a piece of runtime information of a foreign table on OBS in a query.
GS_OBSSCANINFO GS_OBSSCANINFO defines the OBS runtime information scanned in cluster acceleration scenarios. Each record corresponds to a piece of runtime information of a foreign table on OBS in a query.
Column Type Description nodename TEXT Cluster node hostname TEXT Server node traffic_mb float8 OBS write traffic statistics during the 10 minutes before logtime bandwidth_mb_per_s float8 Average bandwidth, in MB/s reqcount Bigint Number of OBS writes during the 10 minutes before logtime
Column Type Description nodename TEXT Cluster node hostname TEXT Server node traffic_mb float8 OBS read traffic statistics during the 10 minutes before logtime bandwidth_mb_per_s float8 Average bandwidth, in MB/s reqcount Bigint Number of OBS reads during the 10 minutes before logtime
<obs_bucket_name> indicates the OBS bucket name. Only some regions are supported. For details about the supported regions and OBS bucket names, see Supported Regions.
<obs_bucket_name> indicates the OBS bucket name. Only some regions are supported. For details about the supported regions and OBS bucket names, see Supported Regions.
Overview In the storage-compute decoupling architecture, user data is stored in OBS to reduce storage costs. Each query generates network I/Os to retrieve data from OBS.
PGXC_OBS_IO_SCHEDULER_PERIODIC_STATS PGXC_OBS_IO_SCHEDULER_PERIODIC_STATS provides statistics on the number of requests and flow control information for different types of OBS I/O Scheduler requests, including read, write, and file operations.
PGXC_OBS_IO_SCHEDULER_STATS PGXC_OBS_IO_SCHEDULER_STATS displays the latest real-time statistics about read/write requests of the OBS I/O Scheduler. This system view is supported only by clusters of version 9.1.0 or later.
If the data source is OBS, set this parameter to the OBS agency name. user_pwd No String Password This parameter is mandatory when the data source is MRS. description No String Description.
Possible Causes The source file stored on OBS contains non-UTF-8 data. Handling Procedure Check whether the source file contains non-UTF-8 data, for example, Chinese characters.
Table 2 OPTIONS parameters Parameter Description Value Range address Specifies the IP address of the OBS service endpoint or HDFS cluster. OBS: Specifies the endpoint of the OBS service.
Step 2: Uploading Data to OBS Create an OBS bucket and upload the local CSV data to the bucket.
Note that <obs_bucket_name> in the following statement indicates the OBS bucket name. Only some regions are supported. For details about the supported regions and OBS bucket names, see Table 1. GaussDB(DWS) clusters do not support cross-region access to OBS bucket data.
Step 1: Starting Preparations This guide is an introductory tutorial that demonstrates how to create a sample GaussDB(DWS) cluster, connect to the cluster database, import the sample data from OBS, and analyze the sample data. You can use this tutorial to evaluate GaussDB(DWS).
Importing data from the OBS Upload data to OBS and then export it to GaussDB(DWS) clusters. Data formats such as CSV and TEXT are supported.
You can choose to set a global OBS bucket, and any file directories you create will be saved to this bucket's folder by default.
