Oracle Cloud Infrastructure (OCI) Streaming service is a real-time, serverless, Apache Kafka-compatible event streaming platform for developers and data scientists. Streaming is tightly integrated with OCI, Database, GoldenGate, and Integration Cloud. The service also provides out-of-the-box integrations for hundreds of third-party products across categories such as DevOps, databases, big data, and SaaS applications.
Data engineers can easily set up and operate big data pipelines. Oracle handles all infrastructure and platform management for event streaming, including provisioning, scaling, and security patching.
With the help of consumer groups, Streaming can provide state management for thousands of consumers. This helps developers easily build applications at scale.
Native integrations with Oracle Cloud Infrastructure services include Object Storage for long-term storage, Monitoring for observability, Resource Manager for deploying at scale, and Tagging for easier cost tracking/account management.
The Kafka Connect Harness provides out-of-the-box integrations with hundreds of data sources and sinks, including GoldenGate, Integration Cloud, Database, and compatible third-party offerings.
Run open source software as an Oracle-managed service. Streaming’s Kafka compatibility significantly reduces vendor lock-in and helps customers easily adopt hybrid and multicloud architectures.
Developers have the flexibility of using either Apache Kafka APIs or Oracle Cloud’s native Streaming APIs, which are available in SDKs such as Python, Java, Typescript, and Go.
Customers with existing Kafka implementations, whether deployed on-premises or on other clouds, can easily migrate to Streaming by changing a few configuration parameters.
For security, the service provides data encryption both in transit and at rest. Streaming is integrated with Identity and Access Management (IAM) for fine-grained access control, as well as Private Endpoints and Vault (KMS) for data privacy.
The service uses synchronous data replication across geographically distributed Availability Domains for fault tolerance and durability. Streaming is backed by a 99.95% service availability SLA. Oracle will provide credits for any breaches of this SLA.
Streaming provides tenancy-level data isolation and eliminates “noisy neighbor” performance issues, irrespective of scale and usage.
Customers pay only for what they use, making the service attractive for workloads with large spikes in usage.
Customers pay only for throughput and storage, with no upfront costs or early termination penalties.
Unlike other public cloud providers, Oracle does not charge any additional fees for data movement from Streaming to other Oracle Cloud Infrastructure services.
Customers use Streaming as a high speed asynchronous message bus to communicate between their microservices. The service’s compatibility with Kafka APIs allows customers to interact with hundreds first- and third-party tools using the Kafka Connect framework.
Streaming service is ideal for microservices and other applications that require high throughput/low latency data movement and strict ordering guarantees.
Feed data at scale from websites or mobile apps to a data warehouse, monitoring system, or analytics engine. Real-time actions help ensure that developers can take action before data goes stale.
Use Streaming to ingest application and infrastructure logs from Oracle SaaS applications, such as E-Business Suite, PeopleSoft, and Change Data Capture (CDC) logs from Oracle Database. Leverage Streaming’s Kafka connectors for Oracle Integration Cloud, then transport them to downstream systems, such as Object Storage, for long-term retention.
OCI Streaming is directly integrated with OCI GoldenGate Stream Analytics, OCI GoldenGate, and Oracle GoldenGate for ingesting event-driven, streaming Kafka messages and publishing enriched and transformed messages. OCI GoldenGate Stream Analytics is a complete application that models, processes, analyzes, and acts in real time, flowing from business transactions, loading data warehouses, or data-in-motion. Users easily build no-code data pipelines. Processing discovers outliers and anomalies, applies insight from ML models, and then alerts or automatically takes the next best action.
Todd Sharp, Developer Evangelist, Oracle
In my last post, I talked about some of the reasons why it makes sense to take advantage of the power of our RDBMS to handle data instead of manually implementing solutions in our application code. In the next few posts, I'm going to start backing up some of that reasoning with some actual examples…Read the complete post
Gain free hands-on experience with Streaming service.
Frequently asked questions about Streaming service.
Find out how Streaming service can help you.