Oracle by Example brandingGetting Started with Oracle Stream Analytics

section 0Before You Begin

This 15-minute tutorial shows you how to push sample data to the Stream Analytics pipeline and create supporting artifacts.

Background

Stream Analytics is a feature of Oracle Integration Cloud. It's an intuitive, web-based interface, powered by Spark Streaming and Kafka Messaging runtime, and the interface enables you to explore, analyze, and manipulate streaming data sources in real time.

What Do You Need?

  • Provisioned instance of Stream Analytics
  • Downloaded and installed cURL command-line utility
  • REST proxy enabled on Oracle Event Hub Cloud Service
  • At least one Apache Kafka topic available in Oracle Event Hub Cloud Service (In this tutorial, myfirstday is used as the topic name.)
  • Zookeeper URL
  • REST proxy details (URL, user name, and password)
  • REST proxy endpoint URL that maps to an existing Kafka topic in Oracle Event Hub Cloud Service (for example, https://host:port/restproxy/topics/myfirstday)

section 1Push Sample Data to the REST Endpoint

  1. In the cURL console, push events.
    2. curl -X POST -k -H "Content-Type: application/vnd.kafka.json.v1+json" -d 
    "{ \"records\":[{\"key\": \"input\", \"value\":{\"text\":\"My First Day\"}}]}" 
    -u user:password $REST_PROXY_URL
  2. Verify the response. If your response is similar to the following, then the data was pushed successfully. 
    {"offsets":[{"partition":0,"offset":0,"error_code":null,"error":null}],
    "key_schema_id":null,"value_schema_id":null}

section 2Create a Connection

  1. In the left navigation tree, click Catalog.
  2. In the Create New Item menu, select Connection.
  3. In the Create Connection dialog box, on the Type Properties tab, enter or select the following values and click Next:
    • Name: MyFirstConnection
    • Connection Type: Kafka
    The Properties tab of the Create Connection dialog box
    Description of the illustration create_connection.png
  4. On the Type Properties tab, enter the Zookeepers URL that you recorded when you provisioned Oracle Integration Cloud and then click Test Connection.
  5. After the “successful” message appears, click Save.

section 3Create a Stream

  1. In the left navigation tree, click Catalog.
  2. In the Create New Item menu, select Stream.
  3. In the Create Stream dialog box, on the Type Properties tab, enter or select the following values and click Next:
    • Name: MyFirstStream
    • Stream Type: Kafka
    The Properties tab in the Create Connection dialog box
    Description of the illustration create_stream.png
  4. On the Source Details tab , select the following values and click Next:
    • Connection: MyFirstConnection
    • Topic name: myfirstday
  5. On the Shape tab, click Detect Shape and simultaneously push several events into Apache Kafka. The shape detection works only with live data in the stream, and the fields are auto populated.
  6. Click Save.

section 4Create a Pipeline

  1. In the left navigation tree, click Catalog.
  2. In the Create New Item menu, select Pipeline.
  3. In the Create New Pipeline dialog box, enter or select the following values and click Save:
  4. In the pipeline editor, wait for the Listening to events message to appear in the Live Output Stream table.
  5. Push several events and watch the events stream into the application.
    6. The Live Streaming Data in the Pipeline
    Description of the illustration app_live_data_streaming.png

more informationWant to Learn More?