Oracle HeatWave GenAI provides integrated, automated, and secure generative AI with in-database large language models (LLMs); an automated, in-database vector store; scale-out vector processing; and the ability to have contextual conversations in natural language—letting you take advantage of generative AI without AI expertise, data movement, or additional cost. HeatWave GenAI is available in Oracle Cloud Infrastructure (OCI), Amazon Web Services (AWS), and Microsoft Azure.
Don’t miss the Oracle CloudWorld keynote by Edward Screven, Oracle’s chief corporate architect, on September 11 at 8:30 a.m. PT: “Build Generative AI Applications—Integrated and Automated with HeatWave GenAI.”
Use in-database LLMs across clouds and regions to help retrieve data and generate or summarize content—without the hassle of external LLM selection and integration.
Let LLMs search your proprietary documents to help get more accurate and contextually relevant answers—without AI expertise or moving data to a separate vector database. HeatWave GenAI automates embedding generation.
Get rapid insights from your documents via natural language conversations. The HeatWave Chat interface preserves context to help enable human-like conversations with follow-up questions.
Use the built-in LLMs in all Oracle Cloud Infrastructure (OCI) regions, OCI Dedicated Region, and across clouds and get consistent results with predictable performance across deployments. Help reduce infrastructure costs by eliminating the need to provision GPUs.
Access pretrained foundational models from Cohere and Meta via the OCI Generative AI service when using HeatWave GenAI on OCI and via Amazon Bedrock when using HeatWave GenAI on AWS.
Have contextual conversations in natural language informed by your unstructured data in HeatWave Vector Store. Use the integrated Lakehouse Navigator to help guide LLMs to search through specific documents, helping you reduce costs while getting more accurate results faster.
HeatWave Vector Store houses your proprietary documents in various formats, acting as the knowledge base for retrieval-augmented generation (RAG) to help you get more accurate and contextually relevant answers—without moving data to a separate vector database.
Leverage the automated pipeline to help discover and ingest proprietary documents in HeatWave Vector Store, making it easier for developers and analysts without AI expertise to use the vector store.
Vector processing is parallelized across up to 512 HeatWave cluster nodes and executed at memory bandwidth, helping to deliver fast results with a reduced likelihood of accuracy loss.
“HeatWave GenAI makes it extremely simple to take advantage of generative AI. The support for in-database LLMs and in-database vector creation leads to significant reduction in application complexity, predictable inference latency, and, most of all, no additional cost to us to use the LLMs or create the embeddings. This is truly the democratization of generative AI, and we believe it will result in building richer applications with HeatWave GenAI and significant gains in productivity for our customers.”
—Vijay Sundhar, CEO, SmarterD
“We heavily use the in-database HeatWave AutoML for making various recommendations to our customers. HeatWave’s support for in-database LLMs and in-database vector store is differentiated and the ability to integrate generative AI with AutoML provides further differentiation for HeatWave in the industry, enabling us to offer new kinds of capabilities to our customers. The synergy with AutoML also improves the performance and quality of the LLM results.”
—Safarath Shafi, CEO, EatEasy
“HeatWave in-database LLMs, in-database vector store, scale-out in-memory vector processing, and HeatWave Chat are very differentiated capabilities from Oracle that democratize generative AI and make it very simple, secure, and inexpensive to use. Using HeatWave and AutoML for our enterprise needs has already transformed our business in several ways, and the introduction of this innovation from Oracle will likely spur growth of a new class of applications where customers are looking for ways to leverage generative AI on their enterprise content.”
—Eric Aguilar, Founder, Aiwifi
Built-in LLMs and HeatWave Chat help enable you to deliver apps that are preconfigured for contextual conversations in natural language. There’s no need for external LLMs and GPUs.
HeatWave GenAI can help you easily converse with your data, perform similarity searches across documents, and retrieve information from your proprietary data.
Empower developers and business teams with integrated capabilities and automation to take advantage of generative AI. Easily enable natural language conversations and RAG.
You can use the in-database LLMs to help generate or summarize content based on your unstructured documents. Users can ask questions in natural language via applications, and the LLM will process the request and deliver the content.
You can combine the power of generative AI with other built-in HeatWave capabilities, such as machine learning, to help reduce costs and obtain more accurate results faster. In this example, a manufacturing company does so for predictive maintenance. Engineers can use Oracle HeatWave AutoML to help automatically produce a report of anomalous production logs and HeatWave GenAI helps to rapidly determine the root cause of the issue by simply asking a question in natural language, instead of manually analyzing the logs.
Chatbots can use RAG to, for example, help answer employees’ questions about internal company policies. Internal documents detailing policies are stored as embeddings in HeatWave Vector Store. For a given user query, the vector store helps to identify the most similar documents by performing a similarity search against the stored embeddings. These documents are used to augment the prompt given to the LLM so that it provides an accurate answer.
Developers can build applications leveraging the combined power of built-in machine learning, generative AI, and vector store to deliver personalized recommendations. In this example, the application uses the HeatWave AutoML recommender system to recommend restaurants based on the user’s preferences or what the user previously ordered. With HeatWave Vector Store, the application can additionally search through restaurants’ menus in PDF format to suggest specific dishes, providing greater value to customers.
Similarity search focuses on finding related content based on semantics. Similarity search goes beyond simple keyword searches by considering the underlying meaning instead of only searching the applied tags. In this example, a lawyer wants to quickly identify a potentially problematic clause in contracts.
Nipun Agarwal, Oracle Senior Vice President, HeatWave and MySQL Development
Oracle HeatWave provides automated, integrated, and secure generative AI and machine learning in one fully managed cloud service for transactions and lakehouse-scale analytics. New features are available across the HeatWave portfolio, on both OCI and AWS.
Read the complete post“HeatWave’s engineering innovation continues to deliver on the vision of a universal cloud database. The latest is generative AI done ‘HeatWave style’—which includes the integration of an automated, in-database vector store and in-database LLMs directly into the HeatWave core. This enables developers to create new classes of applications as they combine HeatWave elements.”
“HeatWave is taking a big step in making generative AI and Retrieval-Augmented Generation (RAG) more accessible by pushing all the complexity of creating vector embeddings under the hood. Developers simply point to the source files sitting in cloud object storage, and HeatWave then handles the heavy lift.”
Follow step-by-step instructions and use the code we provide to quickly and easily build applications powered by HeatWave GenAI.
Sign up for a free trial of HeatWave GenAI. You’ll get US$300 in cloud credit to try its capabilities for 30 days and get access to numerous HeatWave capabilities for free for an unlimited time.
Interested in learning more about HeatWave GenAI? Let one of our experts help.