HeatWave—In-Memory Query Accelerator with Built-in ML
Increases MySQL performance by orders of magnitude for analytics and mixed workloads. Eliminates the need for a separate analytics database, separate machine learning (ML) tools, and extract, transform, and load (ETL) duplication. MySQL HeatWave is available on Oracle Cloud Infrastructure (OCI), Amazon Web Services (AWS), and Microsoft Azure.
Transactions, analytics, and machine learning inside MySQL HeatWave
Oracle MySQL HeatWave is the only MySQL cloud service with a built-in, high performance, in-memory query accelerator—HeatWave. It increases MySQL performance by orders of magnitude for analytics and mixed workloads without any changes to current applications. Customers run analytics on data that’s stored in MySQL databases without a separate analytics database and ETL duplication. MySQL HeatWave is available on Oracle Cloud Infrastructure (OCI), Amazon Web Services (AWS), and Microsoft Azure.
With MySQL HeatWave AutoML, developers and data analysts can build, train, deploy, and explain machine learning models in MySQL HeatWave without moving data to a separate machine learning service.
Discover how to provision a MySQL HeatWave instance on AWS, how to access it with low latency, and how to move data to MySQL HeatWave.
See how to process and query hundreds of terabytes of data in the object store in a variety of file formats, such as CSV, Parquet, and Aurora and Redshift backups.
See how MySQL Autopilot increases the performance of HeatWave while saving significant time for developers and DBAs.
See how you can scale up or down to any number of nodes without any downtime, ending the operation with a completely balanced cluster without any manual intervention.
The Brazilian martech company accelerates marketing insights in milliseconds and at half the cost with MySQL HeatWave on Oracle Cloud Infrastructure.
Japan’s leading advertising network delivers real-time insights and significantly reduces costs with MySQL HeatWave and Autonomous Database.
Migrate to MySQL HeatWave with free step-by-step resources.
MySQL HeatWave: architected for performance and scalability
Designed for performance and scalability
HeatWave uses a columnar in-memory representation that facilitates vectorized processing. The data is encoded and compressed prior to being loaded in memory. This compressed and optimized in-memory representation is used for both numeric and string data. This results in significant performance improvements and a reduced memory footprint, translating into reduced costs for customers.
Scalability across cores and nodes
One of the key design points of the HeatWave engine is to massively partition data across a cluster of HeatWave nodes, which can be operated in parallel. This enables high cache hits for analytic operations and provides very good inter-node scalability. Each HeatWave node within a cluster and each core within a node can process partitioned data in parallel, including parallel scans, joins, group-by, aggregation and top-k processing.
Real-time analytics
Modifications made by OLTP transactions are propagated in real-time to HeatWave and immediately visible for analytics queries. Once users submit a query to the MySQL database, the MySQL query optimizer transparently decides if the query should be offloaded to the HeatWave cluster for accelerated execution. This is based on whether all operators and functions referenced in the query are supported by HeatWave and if the estimated time to process the query with HeatWave is less than with MySQL. If both conditions are met, the query is pushed to HeatWave nodes for processing. Once processed, the results are sent back to the MySQL database node and returned to users. .
Overlap compute with communication
HeatWave implements state-of-the-art algorithms for distributed in-memory analytic processing. Joins within a partition are processed fast by using vectorized build and probe join kernels. The highly optimized network communication between analytics nodes is achieved by using asynchronous batch I/Os. The algorithms are designed to overlap compute time with communication of data across nodes, which helps achieve high scalability.
MySQL Autopilot: machine-learning–based automation
MySQL Autopilot automates many of the most important and often challenging aspects of achieving high query performance at scale—including provisioning, data loading, query execution, and failure handling. It uses advanced techniques to sample data, collect statistics on data and queries, and build machine-learning models to model memory usage, network load, and execution time. These machine-learning models are then used by MySQL Autopilot to execute its core capabilities. MySQL Autopilot makes the HeatWave query optimizer increasingly intelligent as more queries are executed, resulting in continually improving system performance over time. MySQL Autopilot also provides capabilities designed to improve the performance and price-performance of OLTP workloads. MySQL Autopilot is available at no additional charge for MySQL HeatWave customers.
100X faster data recovery
When data is loaded from MySQL into HeatWave, a copy of the in-memory representation is made to the scale-out data management layer built on the OCI object store. Changes made to data in MySQL are transparently propagated to this data layer. When an operation requires reloading of data to HeatWave, such as during error recovery, data can be accessed from the HeatWave data layer, in parallel, by multiple HeatWave nodes. This results in a significant improvement in performance. For example, for a 10 TB HeatWave cluster, the time it takes to recover and reload data reduces from 7.5 hours to 4 minutes—an improvement of over 100X.
No changes required to applications
HeatWave is designed as a MySQL pluggable storage engine, which completely shields all the low-level implementation details from customers. As a result, applications and tools seamlessly access HeatWave through MySQL, using standard connectors. HeatWave supports the same ANSI SQL standard and ACID properties as MySQL, and supports diverse data types. This enables existing applications to take advantage of HeatWave without any changes.
OLTP on-premises, OLAP in the cloud
On-premises customers who cannot move their MySQL deployments to a cloud due to compliance or regulatory requirements can still leverage HeatWave by using the hybrid deployment model. In such a hybrid deployment, customers can use MySQL replication to replicate on-premises MySQL data to HeatWave without the need for ETL.
In-database machine learning
With native, in-database machine learning in MySQL HeatWave, available at no extra cost, users don’t need to move data to a separate machine learning service such as Amazon SageMaker—accelerating their ML initiatives, increasing security, and reducing costs. HeatWave AutoML automates the machine learning lifecycle, including algorithm selection, intelligent data sampling for model training, feature selection, and hyperparameter tuning—saving customers significant time and effort. Developers and data analysts can build machine learning models using familiar SQL commands; they don’t have to learn new tools and languages. Additionally, HeatWave AutoML is integrated with popular notebooks such as Jupyter and Apache Zeppelin. HeatWave AutoML delivers predictions with an explanation of the results, helping organizations with regulatory compliance, fairness, repeatability, causality, and trust.
Consistent high performance and reduced costs with no downtime
Real-time elasticity enables customers to increase or decrease the size of their HeatWave cluster by any number of nodes without incurring any downtime or read-only time. The resizing operation takes only a few minutes, during which time HeatWave remains online, available for all operations. Once resized, data is downloaded from object storage, automatically repartitioned among all available cluster nodes, and becomes immediately available for queries. As a result, customers benefit from consistently high performance, even at peak times, and reduce costs by downsizing their HeatWave cluster when appropriate—without incurring any downtime or read-only time. Customers aren’t constrained to overprovisioned instances forced by rigid sizing models offered by other cloud database providers. With efficient data reloading from object storage, customers can also pause and resume their HeatWave cluster to reduce costs.
Lower costs
Data compression in the HeatWave cluster allows each node to process up to 2X more data without any degradation in price performance for queries. With data compression, customers can reduce the number of HeatWave nodes needed to process queries and cut their costs by up to 50%—while maintaining a constant price performance ratio. Compressed data in the HeatWave cluster is persistent in object storage.
Fast analytics across database and object store
MySQL HeatWave expands to include MySQL HeatWave Lakehouse, letting users process and query hundreds of terabytes of data in the object store—in a variety of file formats, such as CSV, Parquet, and Aurora/Redshift backups. Customers can query transactional data in MySQL databases, data in various formats in object storage, or a combination of both using standard MySQL commands. Querying the data in the database is as fast as querying data in the object store. The HeatWave cluster scales to 512 nodes, letting customers query up to 400 TB of data with MySQL HeatWave Lakehouse.
This fintech startup from Saudi Arabia moved its database workloads to MySQL HeatWave for 3X greater performance and 60% lower costs than another cloud provider. Tamara has grown its client base to more than 2 million users and onboarded 3,000 merchants.
Global high-tech solution provider in the telecom industry speeds up complex queries by 139X with MySQL HeatWave on AWS—simplifying its infrastructure for OLTP and OLAP while delivering subsecond response times to customers.
Get hands-on with MySQL HeatWave on OCI or AWS
-
Activate your MySQL HeatWave trial
-
Run OLTP and OLAP workloads directly from MySQL
-
Automate MySQL HeatWave with machine learning
-
Easily migrate to MySQL HeatWave
-
Get started with MySQL HeatWave on AWS
Explore MySQL HeatWave
Try MySQL HeatWave for free
Explore with $300 in free credits.
Contact us
Interested in learning more? Contact one of our experts.