OCI Search Service with OpenSearch is an insight engine offered as an OCI managed service, making it easy for customers to ingest, search, visualize, and analyze data. We remove the operational burden of managing search infrastructure by automating typical maintenance activities, including patching, updating, upgrading, backups, and resizing—all without downtime. Customers can ingest, store, search, and analyze huge volumes of data quickly and see results in near real time.
OpenSearch and OpenSearch Dashboards—a visualization and user interface—were forked from Elasticsearch 7.10.2 and Kibana 7.10.2 in 2021 and now operate as an Apache 2.0–licensed, separate open source project supported by a community that includes Oracle and AWS as key contributing members.
Elastic announced they will change their software licensing strategy and will not release new versions of Elasticsearch and OpenSearch Dashboards under the Apache License, Version 2.0 (ALv2). Instead, new versions of the software will be offered under the Elastic License or the Server Side Public License. However, both licenses limit usage of the software in ways that make it unacceptable to many in the open source community. In order to ensure open source versions of both packages, OpenSearch was created and will maintain an ALv2-licensed fork of open source Elasticsearch and Kibana.
OCI Search Service with OpenSearch has an unparalleled level of configuration. You’re not locked into specific shapes or SKUs; instead, we use flex shapes that allow you to configure the precise number of compute cores and amount of memory and storage based on your exact requirements.
OCI Search Service with OpenSearch customers can customize their OCPU (compute cores), memory, storage, backup, node count, and node type (for example, master, data, and Open Dashboard nodes). While Logstash isn’t included as part of the managed service, you can send data to OCI Search Service with OpenSearch using Logstash, Beats, and dozens of other clients and applications, just as you would send data to any other Elasticsearch cluster.
OCI Search Service with OpenSearch manages the work involved in setting up your cluster, including provisioning infrastructure. Once your cluster is running, OCI Search Service with OpenSearch handles common administrative tasks, such as performing backups, monitoring instances, and patching software. OCI Search Service with OpenSearch integrates with OCI Metrics to produce metrics that provide information about the state of the clusters. OCI Search Service with OpenSearch also offers customers the ability to modify their cluster configuration and total data size without a service disruption.
The service is available from May 2022.
Managing your own ELK stack can consume significant resources just for operational management and overhead. Moving to a managed service empowers customers to schedule operational actions, and OCI Search Service with OpenSearch takes away those tasks. Also, from a price standpoint, OCI Search Service with OpenSearch is an extremely cost-competitive solution if you’re hosted elsewhere or if you’re managing your own stack.
OCI will continue to enhance scale limits to meet the needs of the largest customers. We currently support 0.3 PB, and larger capacity sizes are available on request.
Customers are billed only for the underlying infrastructure the clusters consume—including the compute, memory, block volume, and object storage costs—without any upcharge. OCI Search Service with OpenSearch will charge a service fee of US$0.25 per hour per data node when more than two data nodes are used per cluster, with service fees waived in perpetuity for the first two nodes in a cluster. For example, if a customer has three data nodes, they’ll be charged US$0.25 per cluster hour. The first two data nodes incur no service fee. Only the third data node and additional data nodes thereafter will incur a service fee of US$0.25 per data node per cluster.
We will continue to enhance OCI’s OpenSearch offering based on customer input and offer scale and performance improvements to provide customers with the optimal OpenSearch development and operational experience.
OCI Search Service with OpenSearch is designed with high availability as a core tenet and is backed by OCI’s enterprise-grade infrastructure availability uptimes. The service will launch with a 99.5% service-level objective, and SLAs will be published after operationalizing production workloads in the near future.
We recommend you evaluate our service in parallel with your current solution to start. If you only focus on time series–type data, you will cut over to OCI OpenSearch once we’ve met all your requirements and stop ingesting to your existing stack. If you need all the data in your existing cluster, you'll need to take a snapshot of your current production cluster using Oracle Cloud Infrastructure Object Storage and restore the snapshot in your service instance. A sample sequence of steps to complete that migration is outlined below.
We’re looking to simplify and automate the migration process in an upcoming release.
You can increase node counts as well as node configuration (OCPU and memory). This means you can increase both vertically and horizontally. You can also increase your storage size at any time up to 0.3 PB. Decreasing node and configuration settings is a rarely used operation and is being considered for a future release based on customer requests.
X-pack features are not supported today; however, we are actively building out additional functionality. Please check out the OpenSearch release calendar to see what’s coming: https://opensearch.org/docs/latest/version-history/.
OCI Search Service with OpenSearch is designed with enterprise-grade availability as a core tenet. For clusters with more than two nodes of any type (for example, data nodes, master nodes, and so on), OCI will automatically provision those nodes across domains, enabling resilience across availability domains for high availability.
While OCI does not enforce any service limit on the number of indexes or documents you can store in your cluster, the OpenSearch software is constrained by underlying OS and hardware infrastructure.
In the case of OCI Search Service with OpenSearch, no. For OpenSearch Dashboards, you can configure user access to different charts and data within the OpenSearch Dashboards console.
A list of supported plugins is available here >https://opensearch.org/docs/latest/opensearch/install/plugins/. If there’s a plugin you require, please submit a support request via the OCI console, and we’ll determine when it can be included in the service.
Yes. Simply put, you will point your Logstash instance to the OCI Search Service with OpenSearch API endpoint for data ingestion.
We use version 1.2.4, a mature, stable release, in our initial service rather than v1.3, which was just released in December 2021. We plan to release new versions on a quarterly cadence.
OCI Search Service for OpenSearch is a fully managed, end-to-end service offering availability and data protection. Managing the backups and storage in our tenancy relieves customers from the burden of managing backups and associated storage while enabling OCI to perform operational tasks reliably and securely.
OCI has a strong commitment to security and always wants the customer to control who accesses their cluster and data. Private endpoints allow for a highly secure connection between a service and a customer’s tenancy. Leveraging private endpoints makes it possible for the clusters to function within the service tenancy for ops management while maintaining security by limiting resource access to Ips within the customer's subnet and disallowing access from any other locations.
Although Amazon and AWS are the stewards of the OpenSearch project and associated repositories, there are many significant contributors, including Red Hat, Logz.io, SAP, Capital One, and OCI. OCI has begun contributing to the project and will continue to contribute to the OpenSearch community.