Меню Свяжитесь с нами Вход в Oracle Cloud

HeatWave—In-Memory Query Accelerator with Built-in ML

Increase MySQL performance by orders of magnitude for analytics and mixed workloads. Query data in object storage. Eliminate the need for a separate analytics database; separate machine learning (ML) tools; and extract, transform, and load (ETL) duplication. MySQL HeatWave is available on Oracle Cloud Infrastructure (OCI), Amazon Web Services (AWS), and Microsoft Azure.

Start for free

Request a free MySQL HeatWave workshop

MySQL HeatWave Lakehouse: Scale-out data processing in object storage

Watch Edward Screven, Oracle’s chief corporate architect, discuss the latest innovations in MySQL HeatWave Lakehouse. Learn how it’s possible to analyze massive amounts of data in various formats—with record performance.

Watch the video (24:22)

Transactions, analytics across data warehouses and data lakes, and machine learning in one cloud database service

MySQL HeatWave is a fully managed database service, powered by the HeatWave in-memory query accelerator. It’s the only cloud service that combines transactions, real-time analytics across data warehouses and data lakes, and machine learning in one MySQL Database—without the complexity, latency, risks, and cost of ETL duplication.

With MySQL HeatWave Lakehouse, customers can query half a petabyte of data in object storage and leverage all the benefits of HeatWave, even when their data is stored outside a MySQL Database. With HeatWave AutoML, developers and data analysts can build, train, deploy, and explain machine learning models in MySQL HeatWave without moving data to a separate machine learning service.

Demo: MySQL HeatWave Lakehouse

See how to process and query hundreds of terabytes of data in the object store in a variety of file formats, such as CSV, Parquet, and export files from other databases.

First Principles: Inside MySQL HeatWave Lakehouse on OCI

Discover the novel techniques that power MySQL HeatWave Lakehouse, letting users process and query half a petabyte of data in memory from object storage.

Demo: MySQL HeatWave on AWS

Discover how to provision a MySQL HeatWave instance on AWS, how to access it with low latency, and how to move data to MySQL HeatWave.

Demo: MySQL Autopilot

See how MySQL Autopilot increases the performance of HeatWave while saving significant time for developers and DBAs.

Demo: Real-time elasticity

See how you can scale up or down to any number of nodes without any downtime, ending the operation with a completely balanced cluster without any manual intervention.

Tetris.co speeds real-time insights with MySQL HeatWave

The Brazilian martech company accelerates marketing insights in milliseconds and at half the cost with MySQL HeatWave on Oracle Cloud Infrastructure.

View the Tetris.co story

Migrate to MySQL HeatWave with free step-by-step resources.

Learn more

MySQL HeatWave: Architected for performance and scalability

Cloud database designed for performance and scalability

HeatWave uses a columnar in-memory representation that facilitates vectorized processing. The data is encoded and compressed prior to being loaded in memory. This compressed and optimized in-memory representation is used for both numeric and string data. This results in significant performance improvements and a reduced memory footprint, translating into reduced costs for customers.

Scalability across cores and nodes

One of the key design points of the HeatWave engine is to massively partition data across a cluster of HeatWave nodes, which can be operated in parallel. This enables high cache hits for analytic operations and provides very good inter-node scalability. Each HeatWave node within a cluster and each core within a node can process partitioned data in parallel, including parallel scans, joins, group-by, aggregation and top-k processing.

Real-time analytics

Modifications made by OLTP transactions are propagated in real-time to HeatWave and immediately visible for analytics queries. Once users submit a query to the MySQL database, the MySQL query optimizer transparently decides if the query should be offloaded to the HeatWave cluster for accelerated execution. This is based on whether all operators and functions referenced in the query are supported by HeatWave and if the estimated time to process the query with HeatWave is less than with MySQL. If both conditions are met, the query is pushed to HeatWave nodes for processing. Once processed, the results are sent back to the MySQL database node and returned to users.

Distributed in-memory analytics processing for real-time insights

HeatWave implements state-of-the-art algorithms for distributed in-memory analytic processing. Joins within a partition are processed fast by using vectorized build and probe join kernels. The highly optimized network communication between analytics nodes is achieved by using asynchronous batch I/Os. The algorithms are designed to overlap compute time with communication of data across nodes, which helps achieve high scalability.

MySQL Autopilot: Machine learning-powered automation

MySQL Autopilot automates many of the most important and often challenging aspects of achieving high query performance at scale—including provisioning, data loading, query execution, and failure handling. It uses advanced techniques to sample data, collect statistics on data and queries, and build machine-learning models to model memory usage, network load, and execution time. These machine-learning models are then used by MySQL Autopilot to execute its core capabilities. MySQL Autopilot makes the HeatWave query optimizer increasingly intelligent as more queries are executed, resulting in continually improving system performance over time. MySQL Autopilot also provides capabilities designed to improve the performance and price-performance of OLTP workloads. MySQL Autopilot is available at no additional charge for MySQL HeatWave customers.

100X faster data recovery

When data is loaded from MySQL into HeatWave, a copy of the in-memory representation is made to the scale-out data management layer built on the OCI object store. Changes made to data in MySQL are transparently propagated to this data layer. When an operation requires reloading of data to HeatWave, such as during error recovery, data can be accessed from the HeatWave data layer, in parallel, by multiple HeatWave nodes. This results in a significant improvement in performance. For example, for a 10 TB HeatWave cluster, the time it takes to recover and reload data reduces from 7.5 hours to 4 minutes—an improvement of over 100X.

No changes required to applications with built-in analytics

HeatWave is designed as a MySQL pluggable storage engine, which completely shields all the low-level implementation details from customers. As a result, applications and tools seamlessly access HeatWave through MySQL, using standard connectors. HeatWave supports the same ANSI SQL standard and ACID properties as MySQL, and supports diverse data types. This enables existing applications to take advantage of HeatWave without any changes.

Hybrid cloud—OLTP on-premises, OLAP in the cloud

On-premises customers who can’t move their MySQL deployments to a cloud because of compliance or regulatory requirements can still leverage HeatWave by using the hybrid deployment model. In such a hybrid deployment, customers can use MySQL replication to replicate on-premises MySQL data to HeatWave without the need for ETL.

In-database machine learning with AutoML

With native, in-database machine learning in MySQL HeatWave, available at no extra cost, users don’t need to move data to a separate machine learning service such as Amazon SageMaker—accelerating their ML initiatives, increasing security, and reducing costs. HeatWave AutoML automates the machine learning lifecycle, including algorithm selection, intelligent data sampling for model training, feature selection, and hyperparameter tuning—saving customers significant time and effort. Developers and data analysts can build machine learning models using familiar SQL commands; they don’t have to learn new tools and languages. Additionally, HeatWave AutoML is integrated with popular notebooks such as Jupyter and Apache Zeppelin. HeatWave AutoML delivers predictions with an explanation of the results, helping organizations with regulatory compliance, fairness, repeatability, causality, and trust.

Consistent high performance and reduced costs with no downtime

Real-time elasticity enables customers to increase or decrease the size of their HeatWave cluster by any number of nodes without incurring any downtime or read-only time. The resizing operation takes only a few minutes, during which time HeatWave remains online, available for all operations. Once resized, data is downloaded from object storage, automatically repartitioned among all available cluster nodes, and becomes immediately available for queries. As a result, customers benefit from consistently high performance, even at peak times, and reduce costs by downsizing their HeatWave cluster when appropriate—without incurring any downtime or read-only time. Customers aren’t constrained to overprovisioned instances forced by rigid sizing models offered by other cloud database providers. With efficient data reloading from object storage, customers can also pause and resume their HeatWave cluster to reduce costs.

Fast analytics across databases and object storage

MySQL HeatWave includes MySQL HeatWave Lakehouse, letting users query half a petabyte of data in object storage—in a variety of file formats, such as CSV, Parquet, and export files from other databases. Customers can query transactional data in MySQL databases, data in various formats in object storage, or a combination of both using standard MySQL commands. Querying the data in object storage is as fast as querying the databases. The HeatWave cluster scales to 512 nodes to process half a petabyte of data and the data isn’t copied to the MySQL database.

MySQL HeatWave customer success stories

Tamara scales fast with MySQL HeatWave and Oracle Cloud

This fintech startup from Saudi Arabia moved its database workloads to MySQL HeatWave for 3X greater performance and 60% lower costs. Tamara has grown its client base to more than 2 million users and onboarded 3,000 merchants.

View the Tamara story

6D Technologies demystifies data and analytics with MySQL HeatWave on AWS

This global high-tech solution provider in the telecom industry speeds up complex queries by 139X with MySQL HeatWave on AWS —simplifying its infrastructure for OLTP and OLAP while delivering subsecond response times to customers.

View the 6D Technologies story