Data Transfer Challenges and Solutions
Most projects involve data transfer and there is no guaranteed transfer time standard because it is subject to various factors. The ideal data transfer duration can be calculated using the following formula: Transfer duration (days) = Total capacity (KB)/[Bandwidth per second (Mbit/s) x 125 x Network usage x 60 x 60 x 24] If you want to upload or download 10 TB data to or from Object Storage Service (OBS) at 20 Mbit/s, the transfer duration is at least 62 days theoretically.
DES uses portable storage devices to implement easy and fast data transfer. It costs only 20% of data transfer over the high-speed Internet.
|Available Bandwidth||3-Day Transfer||7-Day Transfer|
DES: Users can enjoy a 10 times higher transfer speed after posting disks.
Customer Requirements： Transferring massive data requires high network bandwidth and is time-consuming.
DES： DES is charged by the volume of transferred data, reducing the data transfer cost to only 20% of that over a high-speed Internet.
Customer Requirements： It is costly to set up and use a high-speed Internet network.
DES： Data is secure during transfer and upload. It is encrypted before transfer and Huawei personnel have no access to keys throughout the whole process.
Customer Requirements： Data is vulnerable to interception during transfer because data is not encrypted.
DES interworks with OBS to transfer massive data through disks and then upload the data to the cloud.
- Submit your order, and then download the signature file to encrypt data.
- After Huawei receives the posted disks, enter the AKs and SKs to upload data.
- After the data upload is complete, download the transfer report and confirm the information to complete the order.
Migration of raw big data
Migrate raw data of genetic engineering, oil exploration, meteorological research, and IoT to OBS.
Reception of interchangeable data
Receive data from business partners using physical storage media, or ask business partners to upload data to HUAWEI CLOUD.
Website content migration
Migrate static resources, such as static website content, images, scripts, and videos, to OBS.
Offline data backup
Send full or incremental backups to OBS to implement reliable and redundant off-site storage. This can be done together with the hybrid cloud backup solution.
If a large volume of data needs to be prepared for disaster recovery, using DES to perform the initial synchronization is more cost effective.
After a user submits an order, an order ID file is automatically generated in the root directory of the device. O&M engineers connect disks to servers after receiving the disks. The system automatically checks whether the disks correspond to the user's order.
Huawei personnel have no access to users' keys. Users enter bucket information, AKs, SKs, and encryption keys in the console to secure data for a transfer.
Supported file systems: EXT2, EXT3, EXT4, FAT32, and EXFAT Supported disk interfaces: USB 2.0, USB 3.0, SATA, and SAS
Data to be uploaded is encrypted at the client side using a 256-bit algorithm.
Statistics report upload
Reports are generated for the customer's confirmation after the upload is complete, including the file quantity and data volume.