检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
In addition, MRS supports fine-grained permission management of OBS for multiple tenants. Permissions to access OBS buckets and objects in the buckets are differentiated based on user roles, so that MRS users can each control a different directory in OBS buckets.
If the current MRS cluster has been connected to OBS (decoupled storage and compute or cold and hot data separation scenarios), you need to manually delete service data on OBS after deleting a component or MRS cluster.
If you want to restore data from OBS, you have connected the Doris cluster to OBS and have the permission to access OBS.
For details about OBS billing, see OBS Billing Overview. Table 2 Parameters for creating a lifecycle rule Parameter Description Example Value Status Whether to enable the lifecycle rule.
What Are the Differences Between OBS and HDFS in Data Storage? What Are the Solutions for Processing 1 Billion Data Records? What are the advantages of the compression ratio of zstd?
Spark Tasks Not to Obtain HBase Token Information Spark Core Enterprise-Class Enhancements Spark SQL Enterprise-Class Enhancements Spark Streaming Enterprise-Class Enhancements Spark Core Performance Tuning Spark SQL Performance Tuning Spark Streaming Performance Tuning Spark on OBS
Permission Policy for Hive Adding a Ranger Access Permission Policy for Yarn Adding a Ranger Access Permission Policy for Spark2x Adding a Ranger Access Permission Policy for Kafka Adding a Ranger Access Permission Policy for HetuEngine Adding a Ranger Access Permission Policy for OBS
If you want to back up data to OBS, you have connected the current cluster to OBS and have the permission to access OBS.
ClickHouse Data Migration and Synchronization Interconnecting ClickHouse with RDS for MySQL Interconnecting ClickHouse with OBS Interconnecting ClickHouse with HDFS (MRS 3.2.0-LTS) Interconnecting ClickHouse with HDFS (MRS 3.3.0-LTS and later) Interconnecting ClickHouse with Kafka
MRS allows you to store data in OBS and use an MRS cluster for data computing only. In this way, storage and compute are decoupled. For details about the components supported by each MRS version, see List of MRS Component Versions. Parent topic: MRS Basics
How Do I Migrate Data from OBS to ClickHouse? How Do I handle the Error Occurred During Table Data Synchronization via Auxiliary ZooKeeper or Replica Data? How Do I Grant the Select Permission at the Database Level to ClickHouse Users?
Import Data from HBase to HDFS A Data Format Error Is Reported When Data Is Exported from Hive to MySQL 8.0 Using Sqoop An Error Is Reported When the sqoop import Command Is Executed to Extract Data from PgSQL to Hive Failed to Use Sqoop to Read MySQL Data and Write Parquet Files to OBS
Application Development How Do I Get My Data into OBS or HDFS? Can MRS Write Data to HBase Through an HBase External Table of Hive? Where Can I Download the Dependency Package (com.huawei.gaussc10) in the Hive Sample Project? Does MRS Support Python Code?
Link Configurations of Loader Jobs Destination Link Configurations of Loader Jobs Managing Loader Jobs Preparing a Driver for MySQL Database Link Importing Data Exporting Data Managing Jobs Operator Help Client Tools Loader Log Overview Example: Using Loader to Import Data from OBS
Parameter Description Table 1 HDFS parameters Parameter Description Default Value fs.obs.security.provider Implementation method of obtaining the key for accessing the OBS file system Value options are as follows: com.huawei.mrs.MrsObsCredentialsProvider: obtains a credential through
If HBase data is stored in OBS, data backup is not supported. If you want to back up data to OBS, you have connected the current cluster to OBS and have the permission to access OBS.
Data Migration Data Migration Solution Information Collection Before Data Migrated to MRS Preparing the Network Before Data Migration to MRS Migrating Data from Hadoop to MRS with CDM Migrating Data from MRS HDFS to OBS with CDM Migrating HDFS Data from a Self-Built Cluster to an
LocalDir LocalHDFS RemoteHDFS NFS CIFS SFTP OBS Flink (Applicable to MRS 3.2.0 and later versions) Flink metadata. LocalDir LocalHDFS RemoteHDFS OBS (available in MRS 3.5.0 and later) Kafka Kafka metadata. LocalDir LocalHDFS RemoteHDFS NFS CIFS OBS NameNode HDFS metadata.
File Format Loader supports the following file formats of data stored in OBS: CSV_FILE: Specifies a text file. When the destination link is a database link, only the text file is supported. BINARY_FILE: Specifies binary files excluding text files.
Enable OBS Local Cache OBS provides local cache that meets your data storage demands, improving the read speed. For example, you can configure a single-disk 100 GB local cache with data_cache=/srv/BigData/data1/impala:100 GB.
