Oracle Connector Hub is a free service that provides a single pane of glass for describing, executing, and monitoring data movements between all your services—within Oracle Cloud Infrastructure and from Oracle Cloud Infrastructure to third-party tools. It helps move data to sink services, such as Oracle’s Logging, Object Storage, Streaming, and Monitoring, by providing out-of-the-box integrations. It can also trigger Functions for lightweight data processing and send Notifications about changes to your infrastructure.
Common use cases include:
The Logging service is a fully managed, highly scalable log management and search platform that simplifies collecting, managing, and exploring your logs. The service brings together your Oracle Cloud Infrastructure and application logs into one view. It lets you seamlessly ingest and manage the logs generated by your resources and applications. You can leverage the powerful log search engine to explore logs. Oracle’s new, intuitive rules engine makes every single. log line actionable in near real time. More details about the Logging service are available here.
Oracle Cloud Infrastructure Object Storage enables customers to store any type of data in its native format. This is ideal for building modern applications that require scale and flexibility, as it can be used to consolidate multiple data sources for analytics, backup, or archive purposes. More details about Object Storage are available here.
Oracle Cloud Infrastructure Streaming is a fully managed solution that enables applications to ingest large amounts of continuous data from multiple sources, making that data available for immediate processing. More details about Streaming are available here.
Oracle Cloud Infrastructure Logging Analytics is a machine-learning–based cloud service that monitors, aggregates, indexes, and analyzes all log data from on-premises and multicloud environments. It enables users to search, explore, and correlate this data to troubleshoot and resolve problems faster and derive insights to make better operational decisions.
Oracle Cloud Infrastructure Monitoring provides your enterprise with fine-grained metrics and notifications to monitor your entire stack. Out-of-the-box performance and health metrics are provided for your Oracle Cloud Infrastructure resources. Additionally, alarms can be created on these metrics using industry standard statistics, trigger operators, and time intervals. Alarms alert you in real time to important changes across your cloud infrastructure and services via Notifications. You can also emit, visualize, and create alarms on your own custom metrics to monitor all of your metrics from one place. Monitoring offers a best-in-class metric engine, allowing you to perform powerful aggregation and slice-and-dice queries across multiple metric streams and dimensions in real time. More details about Monitoring are available here.
Oracle Functions is a functions-as-a-service offering on Oracle Cloud Infrastructure. It is a fully managed, multitenant, secure cloud service that makes it easy to build cloud native applications by letting developers focus on writing code and not on managing infrastructure. More details about Oracle Functions are available here.
Oracle Cloud Infrastructure Notifications is a fully managed, publish/subscribe service that pushes messages to a number of subscription endpoints at scale. Notifications supports delivering notifications via email delivery, Slack, PagerDuty, and custom HTTPS webhooks. More details about Notifications are available here.
Connector Hub is free. You only pay for the source and target services, such as Logging, Object Storage, Monitoring, Streaming, Functions, and Notifications, between which Connector Hub moves data.
You can access Connector Hub using the console (Connector Hub is under data and AI), REST API, command-line interface (CLI), or Terraform. Technical documentation for Connector Hub is available here.
A connector defines the flow of data between a source and target service.
A source is a service that contains data that can be consumed by another service. Examples of source services include Logging and Streaming.
A target is a destination service which can either be a sink that is consuming data from a source, or an operator that is invoked at the end of a flow. Examples of targets are Object Storage, Streaming, and Functions.
Today, the Connector Hub supports Logging and Streaming as a Source and Object Storage, Streaming, Logging Analytics, Monitoring, Functions, and Notifications services as Target services.
A task is a strongly typed unit of work that will be executed on the source data before it is delivered to the target service. Examples include:
The log task is expressed in Logging query language specification. To learn more, see documentation for Logging Query Language Specification.
See documentation for Logging Format Overview.
Once created, connectors run on a continuous basis to move data from a source to a target service.
See documentation for Connector Hub metrics.
Each connector can move data from a single source to a single target.
Only authorized users can manage connectors. To move data from a source, you must give your connector the required authorization to write to the specified target resource in the target service. You can either accept the default policy offered when using the console to define the target service for a connector, or make sure you have the proper authorizations in a group-based policy. For more information about connector authorization, see Write Access to Target Services.
See documentation for Troubleshooting Connectors for the most common issues that you may face when using Connector Hub.