Benefits for Serverless Infrastructure
Functions
-
Full SQL Compatibility
You don't need to have a background in big data to do big data analysis. If you know SQL, you are good to go. The SQL syntax is fully compatible with the standard ANSI SQL 2003.
You don't need to have a background in big data to do big data analysis. If you know SQL, you are good to go. The SQL syntax is fully compatible with the standard ANSI SQL 2003.
-
Serverless Spark/Flink/openLooKeng
Seamlessly migrate your offline applications to the cloud with serverless technology. DLI is fully compatible with Apache Spark, Apache Flink, and Presto ecosystems and APIs.
Seamlessly migrate your offline applications to the cloud with serverless technology. DLI is fully compatible with Apache Spark, Apache Flink, and Presto ecosystems and APIs.
-
Cross-source Analysis
Analyze your data across databases. No migration required. A unified view of your data gives you a comprehensive understanding of your data and helps you innovate faster. There are no restrictions on data formats, cloud data sources, or whether the database is created online or off.
Analyze your data across databases. No migration required. A unified view of your data gives you a comprehensive understanding of your data and helps you innovate faster. There are no restrictions on data formats, cloud data sources, or whether the database is created online or off.
-
Enterprise Multi-tenant
Manage compute or resource related permissions by project or by user. Enjoy fine-grained control that makes it easy to maintain data independence for separate tasks.
Manage compute or resource related permissions by project or by user. Enjoy fine-grained control that makes it easy to maintain data independence for separate tasks.
Application Scenarios
Database Analysis
Application data (such as registration details) is stored in a relational database and needs analysis.
Pain points
Complicated queries are not supported for larger relational databases.
Comprehensive analysis is not possible because database and table partitions are spread in multiple relational databases.
Business data analysis might overload available resources and impact business operations.
Advantages
Precision Marketing
Information from multiple channels needs to be combined for associative analysis to improve the conversion rate.
Advantages
Related Services
Log Analysis
Running a gaming company calls for a quality data analysis platform to improve ad placements, improve new player retention, improve operations, and get better feedback for future game iterations.
PainPoints
Log analysis is usually performed by period. During the idle periods between each task, resources are wasted.
Advantages
Related Services
Log Analysis
If you run a large enterprise, different departments in the company may need to manage resources independently. You need fine-grained permissions management for data security and improved management efficiency.
Advantages
Gene Data Management
Third-party analysis libraries based on the Spark distributed framework, such as ADAM and Hail, are necessary for genome analysis.
Pain Points
High technical skills are required to install analysis libraries such as ADAM and Hail.
Every time you create a cluster, you have to install these analysis libraries again.
Advantages
Related Services
Real-time Risk Control
Almost every aspect of financial services involves some sort of risk control. A comprehensive system is required.
Pain Points
There is very little tolerance for excessive latency when it comes to risk control.
Advantages
Related Services
Real-time Large Screen
With epidemics like COVID-19 raging across the globe, governments need to be able to monitor key data in real-time on a large screen display, so they can scientifically manage epidemic control.
Pain Points
Government employees do not necessarily have a background in big data. SQL is usually far more familiar.
Advantages
Geographic Big Data Analysis
Geographic big data can involve massive volumes of data, for example petabytes of satellite imaging data. It also includes many different types of data. There is, for example, structured remote sensing image raster data, vector data, unstructured spatial location data, and 3D modeling data. An efficient mining tool is a must for geographic data analysis.
Advantages
Comparison Between DLI and Self-built Hadoop
活动对象:华为云电销客户及渠道伙伴客户可参与消费满送活动,其他客户参与前请咨询客户经理
活动时间: 2020年8月12日-2020年9月11日
活动期间,华为云用户通过活动页面购买云服务,或使用上云礼包优惠券在华为云官网新购云服务,累计新购实付付费金额达到一定额度,可兑换相应的实物礼品。活动优惠券可在本活动页面中“上云礼包”等方式获取,在华为云官网直接购买(未使用年中云钜惠活动优惠券)或参与其他活动的订单付费金额不计入统计范围内;
活动对象:华为云电销客户及渠道伙伴客户可参与消费满送活动,其他客户参与前请咨询客户经理
活动对象:华为云电销客户及渠道伙伴客户可参与消费满送活动,其他客户参与前请咨询客户经理
活动时间: 2020年8月12日-2020年9月11日
活动期间,华为云用户通过活动页面购买云服务,或使用上云礼包优惠券在华为云官网新购云服务,累计新购实付付费金额达到一定额度,可兑换相应的实物礼品。活动优惠券可在本活动页面中“上云礼包”等方式获取,在华为云官网直接购买(未使用年中云钜惠活动优惠券)或参与其他活动的订单付费金额不计入统计范围内;
活动对象:华为云电销客户及渠道伙伴客户可参与消费满送活动,其他客户参与前请咨询客户经理
活动对象:华为云电销客户及渠道伙伴客户可参与消费满送活动,其他客户参与前请咨询客户经理
活动时间: 2020年8月12日-2020年9月11日
活动期间,华为云用户通过活动页面购买云服务,或使用上云礼包优惠券在华为云官网新购云服务,累计新购实付付费金额达到一定额度,可兑换相应的实物礼品。活动优惠券可在本活动页面中“上云礼包”等方式获取,在华为云官网直接购买(未使用年中云钜惠活动优惠券)或参与其他活动的订单付费金额不计入统计范围内;
活动对象:华为云电销客户及渠道伙伴客户可参与消费满送活动,其他客户参与前请咨询客户经理
|
Data Lake Insight |
Self-built Hadoop system |
---|---|---|
Cost |
Billing is based on the actual amount of data scanned or used CUH. Up to 50% costs saved. |
High cost due to long-term resource occupation; wastage of resources |
Elastic scalability |
Container-based Kubernetes, intelligent elastic scaling |
N/A |
O&M availability |
Out-of-the-box, serverless architecture, and cross-AZ DR |
Strong technical capabilities are required for configuration and O&M |
Learning cost |
Low. The optimization parameters are standardized based on 10 years' experience in thousands of projects. In addition, DLI provides a GUI for intelligent optimization. |
High. Hundreds of tuning parameters need to be learned. |
Supported data sources |
Cloud: OBS/RDS/DWS/CSS/MongoDB/Redis; On-premises: self-built database/MongoDB/Redis |
Cloud: OBS; On-premises: HDFS |
Ecosystem compatibility |
Data Lake Visualization (DLV), Tableau, Yonghong BI, and Fanruan BI |
Big data ecosystem tool |
Custom image |
Supported. Dependencies can be added as required to meet service diversity requirements. |
Not supported. |
Workflow scheduling |
Scheduling through Data Lake Factory (DLF) in DGC |
Self-built scheduling tools, such as Airflow |
Multiple enterprise-level tenants |
Table-based permission management, providing column level permission granularity. |
File-based permission management |
Performance |
Higher performance with in-depth software and hardware optimization |
Performance is the same as that of Hadoop open-source versions |
Cost
Data Lake Insight
Billing is based on the actual amount of data scanned or used CUH. Up to 50%
costs saved.
Self-built Hadoop system
High cost due to long-term resource occupation; wastage of resources
Elastic scalability
Data Lake Insight
Container-based Kubernetes, intelligent elastic scaling
Self-built Hadoop system
N/A
O&M availability
Data Lake Insight
Out-of-the-box, serverless architecture, and cross-AZ DR
Self-built Hadoop system
Strong technical capabilities are required for configuration and O&M
Learning cost
Data Lake Insight
Low.
The optimization parameters are standardized based on 10 years' experience in
thousands of projects. In addition, DLI provides a GUI for intelligent optimization.
Self-built Hadoop system
High.
Hundreds of tuning parameters need to be learned.
Supported data sources
Data Lake Insight
Cloud: OBS/RDS/DWS/CSS/MongoDB/Redis;
On-premises: self-built database/MongoDB/Redis
Self-built Hadoop system
Cloud: OBS;
On-premises: HDFS
Ecosystem compatibility
Data Lake Insight
Data Lake Visualization (DLV), Tableau, Yonghong BI, and Fanruan BI
Self-built Hadoop system
Big data ecosystem tool
Custom image
Data Lake Insight
Supported. Dependencies can be added as required to meet service diversity
requirements.
Self-built Hadoop system
Not supported.
Workflow scheduling
Data Lake Insight
Scheduling through Data Lake Factory (DLF) in DGC
Self-built Hadoop system
Self-built scheduling tools, such as Airflow
Multiple enterprise-level tenants
Data Lake Insight
Table-based permission management, providing column level permission
granularity.
Self-built Hadoop system
File-based permission management
Performance
Data Lake Insight
Higher performance with in-depth software and hardware optimization
Self-built Hadoop system
Performance is the same as that of Hadoop open-source versions
Success Stories
IDOL GROUP
IDOL uses Huawei Cloud DLI and DGC to analyze real-time behavioral data and match products with customers. As services and users surge, the company faces challenges coping with the traffic peak and ensuring service stability during promotional activities. The DLI+DGC solution provides IDOL with an elastic architecture and high-performance data lake for integrated batch and stream processing.
Documentation
Register with HUAWEI CLOUD to get free services
Register Now