Accelerate AI Edge Workflow Deployment with NVIDIA Holoscan on OCI

Introduction

NVIDIA Holoscan is a platform that helps process sensor data and move it to a GPU for low-latency workloads. It supports a wide range of use cases: medical imaging, industrial monitoring, and more.

This solution brings Holoscan to Oracle Cloud Infrastructure (OCI), showcasing how to deploy a NVIDIA A10 GPU-enabled virtual machine with a fully configured Holoscan container. The setup uses Terraform to provision all required infrastructure. A Jupyter Notebook service is used to implement and customize a Holoscan application.

By eliminating manual setup, this solution demonstrates how developers can quickly build streaming AI pipelines using Holoscan. It also provides a Docker image, complete with example workflows, for a variety of AI edge scenarios.

Demo

Prerequisites and setup

1. Oracle Cloud account—sign-up page
2. NVIDIA NGC API key

Getting started

• Detailed steps and sample code on GitHub

Additional resources

• NVIDIA Holoscan
• NVIDIA Holoscan SDK v3.2.0 examples
• OCI Resource Manager
• Deploy the Terraform stack