Streaming with Apache Kafka

A diagram illustrating a typical data flow using OCI Streaming with Kafka. The diagram consists of three main boxes connected by arrows:

1. The first box on the left, labeled "Data Ingestion," depicts various data sources that feed into the system: notifications, IoT, and logs.
2. An arrow labeled "Source Kafka Connector" points from the “Data ingestion” box to the second box, “OCI Streaming with Kafka.”
3. The second box, "OCI Streaming with Kafka," covers the benefits of the core Kafka service on OCI, which is ideal for processing and analyzing streaming data in real time, e.g., analyzing log data from various sources for immediate insights. With this fully managed service, every aspect of Kafka cluster administration is automated, including high availability, patches, upgrades, backups, scaling, and compliance. It’s 100% compatible with Kafka, so there’s no need to change any application code. The service is also cost-efficient, with pay-as-go, competitive pricing based on compute and storage usage.
4. An arrow labeled "Sink Kafka Connector" points from the “OCI Streaming with Kafka” box to the third box, “Data storage and analytics.”
5. The third box, labeled "Data storage and analytics,” depicts how processed data is stored in databases, data lakes, or other storage solutions and analyzed using advanced analytics tools.
6. This diagram visually depicts the flow of data from ingestion, through Kafka processing, to storage and analytics, highlighting the use of Kafka connectors to manage data movement.