GoldenGate Features

GoldenGate as cloud service on OCI

Real-time and fault tolerant data integration

Oracle Cloud Infrastructure GoldenGate overview (27:13)

OCI GoldenGate enables a real-time, fault-tolerant operational and analytical foundation for an integrated global data fabric. Database replication publishes data and data events into databases, object stores, open source, OCI Streaming, and OCI Stream Analytics to support diverse data platforms across on-premises and cloud systems.

Oracle and non-Oracle data replication

GoldenGate is the premier replication tool for Oracle databases and is used for data integration, high availability, and online migrations. In addition, OCI GoldenGate connects to many non-Oracle and open source databases across on-premises and cloud platforms.

Connections to big data targets and platforms

Integrate across multicloud sources and targets with Kafka, NoSQL databases, object storage, Hadoop, and more.

Streaming data pipelines

Ingest streaming data from GoldenGate database events and Kafka. Build continuous transformation pipelines that include data enrichment, filtering, alerting, API calling, and publishing data.

Batch data pipelines

Supports batch ETL/ELT pipelines that operate with or without GoldenGate real-time replication.

Specialized data-in-motion analytics

Use pattern-matching analytic functions for time-series and geo-spatial data. Discover and test for outliers and anomalies, apply insight from ML models, and then automatically take the next best action.

Database replication for Oracle Database

Faster data movement

GoldenGate connection to the Oracle Database kernel delivers high-speed data movement for the best performance.

Oracle Database optimized for GoldenGate.

Optimization reduces buffer latency for parallel writes to targets.

Database replication for non-Oracle databases

Range of sources and targets

Integrate data among Oracle and non-Oracle databases and data services, such as Microsoft SQL Server, IBM DB2, Teradata, MongoDB, MySQL, PostgreSQL, HDFS, Kafka, Spark, and cloud object stores across cloud providers.

Reliable data transfer

Provide transactional integrity with built-in conflict detection and resolution Deliver data securely with SSL and encryption.

High availability and scalability

Reduce planned downtime

Eliminate downtime during routine database maintenance and upgrades, operating system patches, application upgrades, and platform migrations. All operations are protected with failback capabilities, eliminating the risk of losing data.

Database scalability

Deploy in multi-master or active-active configurations to achieve database scalability or distributed synchronization. Any number of databases can originate transactions and then synchronize with all others for data consistency.

24/7 availability

Oracle Maximum Availability Architecture relies on Oracle GoldenGate to provide zero downtime for planned and unplanned outages and Oracle Active Data Guard to provide zero data loss at any distance.

Optimize server use

Allows for production utilization of live standby servers for high-performance reporting, ETL for operational data stores, and routine backups.

Support for non-Oracle databases

Reduce planned and unplanned downtime, while providing high availability and disaster recovery for non-Oracle platforms.

Real-time distributed data fabric

GoldenGate for Distributed Applications and Analytics

Keep your entire distributed heterogeneous and multicloud data fabric and supporting applications up to date with real-time data replication, propagation, and transaction consistency. Simplify building and operating an event-based and zero data loss data fabric with five integrated enterprise-class components:

  • GoldenGate connectors to capture and apply data from NoSQL and messaging systems
  • GoldenGate big data connectors for object storage, data lake, data warehouse targets
  • Oracle Stream Analytics for continuous ETL and data in-motion analytics
  • GoldenGate Data Streams for developer control over all GoldenGate events
  • Transaction Manager for Microservices Enterprise Edition (MicroTx EE) for transactional integrity

Connect to distributed data everywhere

You can rely on the extensive GoldenGate connector ecosystem that includes Oracle and non-Oracle event and messaging frameworks, NoSQL databases, and data stores for big data, lakehouses, and data warehouses, whether running on-premises or in any cloud, such as Amazon Web Services, Google Cloud Platform, Microsoft Azure, or Oracle Cloud.

Connector support for more than 30 open source, third-party, and Oracle big data technologies, including captures from Kafka, MongoDB, Cassandra, DataStax, and GoldenGate and delivery to Hadoop, Kafka, object stores, and cloud warehouses, such as Snowflake, Azure Synapse, and Google BigQuery. Also provides transformations into XML, JSON, Avro, Parquet, and ORC formats.

Continuous ETL and stream analytics

Continuous ingestion, processing, transformation, and analytics are essential for a real-time data fabric. Oracle Stream Analytics ingests Kafka, JMS, and stateful event streams from GoldenGate extracts and developer-managed data streams. Easily build continuous data ingestion pipelines that filter, transform, detect patterns in time-series and geospatial data, use ONNX machine learning models, and publish data.

Flexible licensing options

The GoldenGate for Distributed Applications and Analytics license includes a complete library of GoldenGate connectors. Customers interested in specific connectors can license connectors individually with GoldenGate for Big Data Targets.

Developer access and control for real-time GoldenGate events using GoldenGate Data Streams

GoldenGate Data Streams (announced with GoldenGate 23c) is a new publish-subscribe REST interface implemented with the AsyncAPI standard. GoldenGate Data Streams allows developers direct access to database DML/DDL events through the GoldenGate event model and streaming data channels with the highest level of transaction integrity.

Ensuring consistency across microservices-based applications

Oracle Transaction Manager for Microservices (MicroTx) simplifies application development and operations by ensuring distributed transaction consistency across polyglot microservices deployed in Kubernetes and/or other environments.

MicroTx EE makes it easy to use distributed transactions in applications deployed in Kubernetes and Docker Swarm. Developers can easily create multi-phase commits, try-confirm/cancel or long-running Saga transaction patterns across a wide range of Java, JavaScript, C/C++, Blockchain, COBOL, and Tuxedo applications.

Aligning microservices applications and data consistency

Using GoldenGate at the data layer ensures data consistency, conflict detection, and zero data loss across a distributed data fabric and increases the reliability and consistency of Oracle Transaction Manager for Microservices for distributed applications. The upcoming GoldenGate Data Streams AsyncAPI will allow developers even more access and control for Oracle data events. Together, microservices developers will have a powerful foundation to build more reliable distributed applications and analytics.

Hands-On Labs

Get hands-on with big data connectors in five on-premises and cloud scenarios: Kafka, HDFS, HBase, Cassandra, and MongoDB and learn how to maintain data consistency across microservices.

Real-time streaming analytics

Complete platform for continuous integration and analytics

Model, process, analyze, publish, and act on real-time streaming data captured from GoldenGate database events, Kafka, or JMS messages.

Extend GoldenGate replication with streaming pipelines

Extend GoldenGate database replication events with next step pipelines that pattern match, correlate, filter, transform, enrich, analyze, alert, and publish data.

Ingest data streams

Capture database events from all GoldenGate sources and from Kafka or JMS.

Easily assemble no-code pipelines

Assemble stream processing pipelines from a library of ready-to-use streaming patterns.

Dynamically refine data pipelines

Fine-tune pipeline transformations, enrichment, data quality, and machine learning functions while ingesting data.

Advanced data-in-motion analytics

Analyze data points and data movement to detect anomalies and other conditions that, in turn, trigger alerts, publish data, and call APIs. Includes many specialized time-series, geo-spatial, and statistical pattern matching analytic functions using continuous SQL.

Native integration with GoldenGate

Prebuilt connections directly capture database events from OCI GoldenGate, GoldenGate, GoldenGate for Big Data, and GoldenGate for Big Data Targets.

Native integration with OCI Streaming

Prebuilt connections to OCI Streaming allow for bidirectional Apache Kafka message transport.

Validate with Oracle GoldenGate Veridata

Data verification

  • Identify table records that are out-of-sync.
  • Verify data consistency across heterogeneous databases.

Data fix

Compare and repair datasets to improve data quality.

Key capabilities

Graphical user experience

Easy-to-use graphical user experience enables administrators to securely configure, monitor, and manage operations from all major desktop browsers.

End-to-end monitoring

Ensure service level agreement commitments with data verification and visibility into extensive real-time performance and usage statistics across all sources and targets.

Extensive operational APIs

Use well-documented REST APIs to customize the administrative user experience, add operational controls into replication processes, and integrate with third-party tools.

Automatic scaling

Achieve optimal throughput regardless of workload variability with dynamic scalability and parallel transaction processing.

Inline transformation

Data replication processes allow for more than 50 built-in data manipulation functions for transformation and validation and stored procedure callouts for further inline data preparation for enrichment, analytics, and more.

Real-time data mesh

Uniquely designed to replicate Oracle and non-Oracle databases and data services across operating systems, endianness, character sets, and object structures. Supports every data movement topology and modern architecture pattern.

More integration solutions

Integrate with Oracle ETL

  • Works with Oracle Data Integrator.
  • Keep data synchronized after performing an initial bulk load.

Integrates with Enterprise Data Quality

Cleanse and profile data for data warehouses and data lakes.

Monitor and manage

Automated monitoring

Visibility into replication status with real-time alerts. View status in a robust management console or engineer automated recovery using rich APIs.

Enterprise-wide visibility

Monitor replication process completion and performance using management dashboards and real-time notifications.

Integrates with Oracle Enterprise Manager

Monitor GoldenGate across the enterprise with centralized management and monitoring, improving productivity.

Oracle GoldenGate Free

Free version

Oracle’s premier database replication platform is available to everyone for free. This version is ideal for prototyping, general education, development, DevOps, and testing. It deploys from a Docker container onto laptops, on-premises, or any cloud.

Includes all GoldenGate features

Use this version for operational and analytical use cases. Includes all enterprise-grade database replication features and runs with the latest microservices architecture.

Easier than ever

Designed for ease of use throughout the replication lifecycle. Build visual replication pipelines from a catalog of common patterns. And once started, the replication process is entirely automated.

Sources and targets

The current version connects to Oracle Databases, but more targets are planned.