检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
DIS transforms data continuously to OBS for computing, analysis, and storage. Figure 1 Data flows Parent topic: General Questions
DIS transforms data continuously to OBS for computing, analysis, and storage. Figure 1 Data flows
The operations apply only to OBS dump tasks. If there are other types of dump tasks, delete them before modifying the permissions. Do not delete the permissions required for non-OBS dump tasks because the deletion cannot be undone.
deploys DIS Data processing Receives user requests; receives and stores authenticated data Receives data read requests and returns the requested data to authorized users Removes old data from DIS streams according to data aging policies Stores user data into Object Storage Service (OBS
DIS transfers data continuously to MapReduce Service (MRS), Data Lake Insight (DLI), Data Warehouse Service (DWS), and Object Storage Service (OBS) for computing, analysis, and storage. Figure 1 Data flow diagram
For example, you can have one application running real-time analytics and another sending data to OBS from the same stream. DIS preserves data for 24 hours, reducing the probability of data loss in case of application failures, individual machine failures, or facility failures.
%s The OBS bucket does not exist. Ensure that the OBS bucket exists. 400 DIS.4307 The stream already exists. The stream already exists. Enter a new stream name. 400 DIS.4308 Insufficient quota. Insufficient stream or partition quotas.
If an IP access control policy has been configured for the OBS bucket to which data is to be dumped, the dump task cannot run properly due to the network isolation between DIS and OBS. To resolve this issue, contact technical support. Click Create Now.
The OBS bucket does not exist. Ensure that the OBS bucket exists. 400 DIS.4307 The stream already exists. The stream already exists. Enter a new stream name. 400 DIS.4308 Insufficient quota. Insufficient stream or partition quotas.
19 { "tasks":[ { "destination_type":"DLI", "task_name":"task_Ztab", "create_time":1552457808502, "state":"RUNNING", "last_transfer_timestamp":1552458085454 }, { "destination_type":"OBS
Billing Modes OBS provides two billing modes: pay-per-use and yearly/monthly. Pay-per-use is recommended if you are unsure of your future service needs and want to avoid paying for unused resources. However, if you are sure of your needs, yearly/monthly will be less expensive.
Stores user data into OBS, MRS, DWS, or DLI. Service maintenance Installs and upgrades DIS. Performs configuration, preventive maintenance, monitoring, and log collection and analysis for DIS. Processes service orders. User SDK Provides Java APIs for users to push and pull data.
the OS Reinstalling the OS Creating an Image Purchasing an EVS Disk Using DIS Using DIS Flume Plugin to Upload and Download Data Using DIS Logstash Plugin to Upload and Download Data Using SparkStraming SDK to Download Data Managing a Dump Task Creating a Dump Task Dumping Data to OBS
Public services, such as Elastic Cloud Server (ECS), Elastic Volume Service (EVS), Object Storage Service (OBS), Virtual Private Cloud (VPC), Elastic IP (EIP), and Image Management Service (IMS), are shared within the same region.
OBS: Data is dumped to OBS. MRS: Data is dumped to MRS. DLI: Data is dumped to DLI. CLOUDTABLE: Data is dumped to CloudTable.
Stream: Upload the matching file to OBS and send the file name to DIS, uncomment # if you want to use this feature #- OBSStream: YOU_DIS_STREAM_3 # filePattern: /opt/*.log # initialPosition: START_OF_FILE # ## bucket name # OBSBucket: YOU_OBS_BUCKET_NAME # ## OBS
an Image Purchasing an EVS Disk Using DIS Using DIS Flume Plugin to Upload and Download Data Using DIS Logstash Plugin to Upload and Download Data Using SparkStraming SDK to Download Data Configuring Security Group Rules Managing a Dump Task Creating a Dump Task Dumping Data to OBS
If Source Data Type is set to BLOB, the supported Dump Destination can be OBS or MRS. JSON: an open-standard file format that uses human-readable text to transmit data objects consisting of attribute–value pairs and array data types.
