Data Lake
A data lake is a repository for structured, semistructured, and unstructured data in any format and size and at any scale that can be analyzed easily. With Oracle Cloud Infrastructure (OCI), you can build a secure, cost-effective, and easy-to-manage data lake. A data lake on OCI is tightly integrated with your preferred data warehouses and analytics as well as with other OCI services, such as data catalog, security, and observability services.
Move your data in batches or streams seamlessly to an OCI data lake where it can be analyzed. Leverage OCI Data Integration, OCI GoldenGate, or OCI Streaming to ingest your data and store it in OCI Object Storage.
A central data lake on OCI integrates with your preferred tools, including databases such as Oracle Autonomous Data Warehouse, MySQL HeatWave, analytics and machine learning (ML) tools such as Oracle Analytics Cloud, and open source projects such as Apache Spark.
A comprehensive set of AI and ML services lets you gain new insights from your data, make predictions, lower your operational overhead, and improve customer experience.
Catalog your data and gather insights about your data lake with OCI Data Catalog. Enable query tools and databases to discover and query your data in the object store.
Get early access to OCI Data Lake
Oracle Cloud Infrastructure is launching a fully managed data lake service called OCI Data Lake this year. You can sign up for early access to explore its features and capabilities before it's released to the public.
Why use a data lake on OCI?
Modernize your data lake
A data lake makes it possible to work with more kinds of data, but the time and effort needed to manage it can be disadvantageous. By offering fully managed open source data lake services, OCI provides both lower costs and less management, so you can expect reduced operational costs, improved scalability and security, and the ability to incorporate all of your current data in one place.
Extend your data warehouse
Data warehouses and data marts are crucial to successful businesses. Integrating them with a data lake will increase their value even more. Integration among databases, data warehouses, and a data lake with Oracle means that data can be accessed from multiple locations with a single SQL query. Current applications and tools get transparent access to all data, with no changes and no need to learn new skills.
Utilize advanced analytics for Oracle applications
Data generated by enterprise applications is highly valuable, but it’s rarely fully utilized. A data lake on OCI simplifies access to data from multiple applications and enables sophisticated analysis that can mean the difference between a good quarter or a bad quarter.
Data lake integrated solution on OCI
Centralize your data with an embedded OCI Data Integration experience.
Query any data from any source without replication.
Preintegrated applications for instantaneous time to value.
Catalog and govern with an embedded OCI Data Catalog experience.
Secure data with fine-grained, role-based access control policies.
Oracle data platform unlocks the full potential of your data
- Combine transactional and analytical data—avoid silos.
- Leverage Oracle IaaS to Oracle SaaS, or anything in between—select the amount of control desired.
- Bring any kind of data to the platform—we break the barrier between structured and unstructured data.
- Explore the power of OCI and its openness to other cloud service providers—we meet you where you are.
- Use leading Oracle Analytics Cloud reporting or any third-party analytical application—OCI is open.
The diagram shows
the Oracle data platform with data sources, data movement services such as integration services, the
core of the Oracle modern data platform, and possible outcome and application development
services. Integrate Autonomous Database with data lakes
Oracle Autonomous Database supports integration with data lakes—not just on Oracle Cloud Infrastructure, but also on Amazon Web Services (AWS), Microsoft Azure, Google Cloud, and more. You have the option of loading data into the database or querying the data directly in the source object store. Both approaches use the same tools and APIs to access the data.
This architecture is sometimes referred to as a lakehouse architecture.
The diagram shows an
architecture of a data platform leveraging Oracle Autonomous Database, with data sources, Oracle
Autonomous Database, and outcomes. Real-time analytics across all your data with MySQL HeatWave Lakehouse
One MySQL cloud database service for transactions, real-time analytics across data warehouses and data lakes, and machine learning—without the complexity, latency, risks, and cost of ETL duplication.
The diagram shows an
architecture of a data platform leveraging Oracle MySQL HeatWave, with data sources, MySQL Heatwave,
and outcomes. Build a data lake with Oracle-managed open source services
Quickly create Hadoop-based or Spark-based data lakes to extend your data warehouses and ensure all data is both easily accessible and managed cost-effectively.
The diagram shows an
architecture of a data platform leveraging Oracle-managed open source services, such as Hadoop,
Spark, and OpenSearch, with data sources, Oracle open source services at the core, and possible
outcomes. Data lake services from Oracle
-
Data motion and integration
-
Connect and extend analytical applications with real-time consistent transactional data, efficient batch loads, and streaming data.
- OCI Data Integration
Simplify your complex data extract, transform, and load processes (ETL/E-LT) into data lakes and warehouses for data science and analytics with a no-code data flow designer. - Oracle Data Integrator
Data Integrator provides advanced data migration for extract, transform, and load. Oracle Data Integrator is optimized for Oracle cloud databases as well as on-premises databases. - Oracle GoldenGate
Oracle GoldenGate enables high-availability, real-time data integration, change data capture, data replication, transformations, and verification between operational and analytical enterprise systems. - OCI Streaming
Streaming provides out-of-the-box integrations for hundreds of third-party products across categories such as DevOps, databases, big data, and SaaS applications.
-
Data lake
-
Build a data lake using fully managed data services with lower costs and less effort.
- OCI Data Lake
Data Lake offers centralized storage and metadata for your structured and unstructured data with unified, fined-grained access control. - OCI Object Storage
Object Storage enables customers to store any type of data in its native format. This is ideal for building modern applications that require scale and flexibility. - OCI Data Catalog
Data Catalog helps data professionals across the organization search, explore, and govern data using an inventory of enterprisewide data assets. - OCI Data Flow
Data Flow is a fully managed Apache Spark service to perform processing tasks on extremely large datasets without infrastructure to deploy or manage. This enables rapid application delivery because developers can focus on app development, not infrastructure management. - Oracle Big Data
Big Data Service is a Hadoop-based data lake service to store and analyze large amounts of raw customer data. A managed service, Oracle Big Data Service comes with a fully integrated stack that includes both open source and Oracle value-added tools that simplify your IT operations.
-
Data lakehouse
-
Leverage OCI integration of your data lakes with your preferred data warehouses and uncover new insights.
- MySQL Heatwave Lakehouse
MySQL HeatWave Lakehouse transparently connects to data lakes, letting users process and query hundreds of terabytes of data in the object store in a variety of file formats, including CSV, Parquet, and Aurora/Redshift backups. - Autonomous Database lakehouse capabilities
Autonomous Database enables a self-service data lakehouse, allowing users to load or directly query files on all object stores (including OCI, AWS, Azure, and Google Cloud Platform). Integrated machine learning, spatial, text, and graph analytics enable insights without moving data.
-
AI and machine learning
-
Gain insights from data with prebuilt AI models, or create your own.
- OCI AI Services
AI Services is a collection of services with prebuilt machine learning models that make it easier for developers to apply AI to applications and business operations. The models can be custom-trained for more accurate business results. - OCI Data Science
Rapidly build, train, deploy, and manage machine learning models with a data science service built for teams. - Machine Learning in Oracle Database
Machine Learning in Oracle Database supports data exploration, preparation, and machine learning modeling at scale. - MySQL HeatWave AutoML
MySQL HeatWave AutoML includes everything users need to build, train, deploy, and explain machine learning models within MySQL HeatWave, at no additional cost.
Data lake customers
Data lakehouse partner ecosystem
Oracle partner solutions leverage and augment data lakehouses on OCI.
Informatica is the preferred partner for data integration and governance for data warehouse and lakehouse solutions.
Data lake adoption on Oracle Cloud Infrastructure
The Oracle Playbook series
We've compiled the secrets to our people, process, and systems strategy. And we want to share them with you.
Get started with a data lake on OCI
Try Always Free cloud services and get a 30-day trial
Oracle offers a Free Tier with no time limits on a selection of services, including Autonomous Data Warehouse, OCI Compute, and Oracle Storage products, as well as US$300 in free credits to try additional cloud services. Get the details and sign up for your free account today.
-
What's included with Oracle Cloud Free Tier?
- Always Free
- 2 autonomous databases, 20 GB each
- Compute VMs
- 100 GB block volume
- 10 GB object storage
Learn with a hands-on lab
The best way to learn is to try it yourself. Try this free data lake workshop, which demonstrates a typical usage scenario and highlights some of the tools you can use to build a data lake.
-
Access the Data Lake using Autonomous Database and Data Catalog
The labs in this workshop walk you through the steps you need to access a data lake created with Oracle Object Storage buckets by using Oracle Autonomous Database and OCI Data Catalog.
Start data lake access lab -
Get Started with Oracle Big Data Service
Learn how to create and monitor a highly available Hadoop cluster using Big Data Service and OCI. You’ll also add Oracle Cloud SQL to the cluster and access the utility and master node, and learn how to use Cloudera Manager and Hue to access the cluster directly in a web browser.
Start the data lake lab -
Learn analytics and machine learning with Red Bull Racing
Use analytics and machine learning to analyze 70 years of racing data. Find out what makes some races so exciting you can’t look away while others are more predictable.
Start the data analytics lab -
Get started with Oracle Cloud Infrastructure Anomaly Detection
Discover how to use OCI Anomaly Detection to create customized machine learning models. You’ll take data uploaded by users, use a specialized algorithm to train a model, and deploy the model into the cloud environment to detect anomalies.
Start the anomaly detection lab now
Contact sales
Interested in learning more about a data lake? Let one of our experts help.
-
They can answer questions such as
- How do I get started with a data lake on Oracle?
- What can I do with a data lake that I can’t do with a data warehouse?
- How can my business benefit from a data lake?