GPU instances

Oracle Cloud Infrastructure (OCI) Compute provides bare metal and virtual machine instances powered by NVIDIA GPUs for a variety of use cases, including mainstream graphics and videos as well as the most demanding AI training and HPC workloads. OCI excels at both training time and cost because of its ultralow latency and near line-rate network performance.

SoundHound scales voice AI on OCI, improving performance
SoundHound scales voice AI on OCI, improving performance 50% to 60% (3:28)

OCI at NVIDIA GTC, the conference for AI and the metaverse

GPU instances—key features

Remote direct memory access (RDMA) communication between instances supports large GPU clusters with 3,200 Gb/sec of bandwidth and ultralow latency.

High performance NVIDIA GPU instances

NVIDIA Tensor Core GPUs

OCI offers the highest value and performance for bare metal and virtual machine compute instances powered by these NVIDIA GPUs: H100, L40S (coming soon), A100, A10, V100, and P100.

Bare metal performance

Bare metal compute instances allow customers to run high performance, latency-sensitive, and specialized workloads directly on server hardware—just as they would on-premises.

High performance cluster networking

Oracle’s ultralow-latency cluster networking, based on RDMA, provides microsecond-level latency. Without compromising on performance, customers can host clusters with 512 or fewer GPUs and OCI Superclusters with more than 512 GPUs.

High performance NVIDIA GPU instances
Bandwidth against cluster nodes; 1 node = 8 NVIDIA A100 GPUs.

Choose from a variety of VM and bare metal compute instances

Virtual machines and bare metal

Match your workload with the best instance type to find your ideal fit.

VM instances

For VMs, choose from NVIDIA Ampere, Volta, and Pascal GPUs with one to four cores, 16 to 64 GB of GPU memory, and up to 480 GB of locally attached flash storage.

Bare metal instances

Cluster bare metal instances for HPC and AI training using NVIDIA H100 or A100 Tensor Core GPUs with 640 GB of GPU memory per node.

Choose from a variety of VM and bare metal compute instances
Comparing the performance of NVIDIA V100 and A10 GPUs

Reduce networking and storage costs

Consistent global pricing

OCI’s pricing is simple and transparent across regions, ensuring that cloud spending is predictable regardless of the location where your workloads run.

Reduce networking and storage costs
Comparing prices of cloud vendors across regions

Secure cloud infrastructure

Isolated network virtualization

Prevent attacks on customer tenancies with isolated network virtualization. A foundational element of Oracle Cloud Infrastructure’s security-first architecture, the design stops malware in its tracks with a custom-designed SmartNIC to isolate and virtualize the network.

Oracle Cloud Infrastructure Identity and Access Management

Using easy-to-define policies organized by logical groups of users and resources, control not only who has access to Oracle Cloud Infrastructure resources but which ones and the access type. Customers manage identities and grant access by leveraging existing organizational hierarchies and federated directory services, including Microsoft, Okta, and other SAML directory providers.

Hardware root of trust

Reduce the risk of firmware-based attacks against Oracle Cloud Infrastructure customer tenants with custom-built, hardware-based, root-of-trust-technology designed to wipe and reinstall the firmware every time a new server is provisioned or a new customer tenancy is established.

Oracle Web Application Firewall

Protect applications from malicious and unwanted internet traffic with a cloud-based, PCI-compliant, global web application firewall (WAF) service. By combining threat intelligence with consistent rule enforcement, this service strengthens defenses and protects internet-facing application servers.

Oracle Cloud Infrastructure Vault

Centrally manage and maintain control of the encryption keys and secret credentials used to protect enterprise data and access resources. The security for both are stored in Federal Information Processing Standards (FIPS) 140-2, Level 3-certified, hardware security module (HSM).

Users can further control permissions for individual keys and vaults with OCI Identity and Access Management and monitor key lifecycle changes with OCI Audit to meet enhanced compliance requirements.

Choice of operating systems

Choose from popular operating systems

Oracle supports an extensive list of Microsoft Windows Server and enterprise Linux operating systems, including Oracle Linux, CentOS, Ubuntu, and many others. Oracle Autonomous Linux is a free, autonomous operating environment that reduces complexity and human error to deliver increased cost savings, security, and availability.

Automate operating system management

The OCI OS Management service allows customers to set policies for automated updates and patches for their operating system environment.

View documentation

Bring your own image (BYOI)

Customers can run their own operating systems and hypervisors on Oracle compute instances and use the same image across configuration sizes.

Access readily-available software

Access software and disk images

Oracle Cloud Marketplace provides software and disk images for data science, analytics, artificial intelligence (AI), and machine learning (ML) models so customers can quickly gain insight from their data.

NVIDIA GPU Cloud

Access hundreds of GPU-optimized applications for machine learning, deep learning, and high performance computing covering a wide range of industries and workloads. Learn more.

NVIDIA RTX Virtual Workstation

Customers can deliver powerful workstation performance wherever employees need it by running NVIDIA RTX Virtual Workstation on Oracle Cloud.

Microservices and containers

Container registry

Developers building applications using containers leverage a highly available, Oracle-managed private container registry service for storing and sharing container images. Push or pull Docker images to and from the registry using the Docker V2 API and the standard Docker command line interface (CLI). Images can be pulled directly into a Kubernetes deployment.

Oracle Functions

Functions as a service (FaaS) lets developers run serverless applications that integrate with Oracle Cloud Infrastructure, Oracle Cloud Applications, and third-party services. Gain developer efficiency along with the community of the open source Fn Project.

Talk with Oracle about accelerating your GPU workloads.

GPU instances—use cases

AI infrastructure for deep learning training and inferencing

Train AI models using OCI Data Science, bare metal instances, cluster networking based on RDMA, and NVIDIA GPUs.


AI training and inferencing This diagram describes two stages of deep learning model development: model training and model inferencing. In model training on the left, the untrained neural network is input to a training algorithm enabled by OCI Data Science, bare metal compute, local storage, and cluster networking. The output of the training algorithm is a trained model with a new capability. The model inferencing step is described on the right. Consider a trained model such as DALL-E 2, which can take text inputs and generate images. A text input is fed into the trained model, and an image output from the model is provided.

Virtual desktop infrastructure (VDI)

OCI Compute powered by NVIDIA GPUs provide consistent high performance for VDI.


Virtual desktop infrastructure Virtual desktop infrastructure

CFD and high performance computing using GPU instances

OCI enables computer-aided engineering and computational fluid dynamics for fast predictions of the aerodynamic properties of objects.


CFD and high performance computing using GPU instances CFD and high performance computing using GPU instances

See how OCI and NVIDIA power next-generation AI models

Adept builds a powerful AI teammate for everyone with Oracle and NVIDIA

“With the scalability and computing power of OCI and NVIDIA technology, we are training a neural network to use every software application, website, and API in existence—building on the capabilities that software makers have already created.”

David Luan, CEO
Adept

National Grid analyzes weather 40% better on Oracle Cloud

“Oracle Cloud Infrastructure allows us to process tens of thousands of models, so we can train our algorithms very quickly. It’s one of the best platforms in the world for the type of work we do.”

James Kelloway, Energy Intelligence Manager
National Grid ESO

SoundHound selects OCI to support huge company growth

“We view this relationship with OCI as long term. We’re excited about taking advantage of the GPUs and using that to train our next generation of voice AI. There's a lot that we think that OCI will provide for us in terms of future growth.”

James Hom, Cofounder and Vice President of Products
SoundHound

Softdrive offers next-generation workstations with OCI Compute and NVIDIA A10

“Softdrive is the future of business computers. In the cloud PC market, performance means everything. NVIDIA GPUs on OCI bare metal servers have dramatically improved the experience for our customers.”

Leonard Ivey, Cofounder
Softdrive

Twist Bioscience leverages OCI and AI to advance protein initiatives

“With NVIDIA GPUs running on OCI bare metal instances, Twist experiences significant performance improvements across its ParaFold and ESMFold AI models.”

WEKA on OCI delivers 2 terabytes per second performance

“Oracle Cloud Infrastructure is a top tier Hyperscaler cloud that provides XaaS compute and application services to Oracle customers, and offers a lot more than you might expect, including AI/ML and GPU workloads.”

Joel Kaufman
Senior Technical Marketing Manager, WEKA

Tango Eye serves more customers at lower cost with Oracle

“Since moving off AWS, we have quadrupled our data footprint while reducing our costs by 40%. We use 33% less GPU compute capacity on OCI than AWS.”

Suren Gounder, CEO
Tango Eye

Altair tests and runs complex simulations overnight on OCI

“The integration with Oracle’s cloud platform provides us with state-of-the-art GPU compute resources, world-class security, and highly flexible VMware environments. Ultimately, this leads to improved productivity, optimized resource utilization, and faster time to market.”

Sam Mahalingam, Chief Technology Officer
Altair

November 13, 2023

Announcing plans to offer NVIDIA Grace Hopper Superchip on OCI

Sagar Rawal, Vice President, Oracle Cloud Infrastructure

Today at SC23, we’re announcing our upcoming plans to offer Oracle Cloud Infrastructure (OCI) Compute instances powered by the NVIDIA GH200 Grace Hopper Superchip. The GH200 consists of an Arm CPU (Grace) linked to an NVIDIA H100 Tensor Core GPU (Hopper) with a high-bandwidth memory space of 576 GB.

Read the complete post

Get started with OCI Compute services

Try 20+ Always Free cloud services, with a 30-day trial for even more

Oracle offers a Free Tier with no time limits on more than 20 services such as Compute, Storage, and Autonomous Database, as well as US$300 in free credits to try additional cloud services. Get the details and sign up for your free account today.

  • What’s included with Oracle Cloud Free Tier?

    • AMD and Arm Compute VMs
    • 200 GB total block storage
    • 10 GB object storage
    • 2 Autonomous Databases, 20 GB each
    • 10 TB outbound data transfer per month
    • 10+ more Always Free services
    • US$300 in free credits for 30 days for even more

Learn with a hands-on lab

The best way to learn is to try it yourself. Use our tutorials and hands-on labs with the Oracle Cloud Free Tier, your own Oracle Cloud tenancy, or for selected solutions in an Oracle-provided free lab environment.

  • Deploy HA Applications Using Load Balancers

    In this lab you will deploy web servers on two compute instances in Oracle Cloud Infrastructure (OCI), configured in High Availability mode by using a Load Balancer.

    Start this lab now
  • Get started with OCI Core Services

    Explore basic OCI services, including Compute, Networking, and Storage.

    Start this lab now
  • Deploy Oracle Container Engine for Kubernetes

    In this lab you will deploy a Container Engine for Kubernetes cluster, connect to it, and run a sample application using OCI CLI.

    Start this lab now
  • Migrate Tomcat Java Applications to OCI

    Explore how to migrate Tomcat to Oracle Cloud Infrastructure and connect to an Autonomous Database.

    Start this lab now

Additional resources

Learn more about preemptible capacity, burstable instances, autoscaling, GPUs, flexible computing, and more.

Explore more than 150 best-practice designs

See how our architects and other customers deploy a wide range of workloads, from enterprise apps to HPC, from microservices to data lakes. Understand the best practices, hear from other customer architects in our Built & Deployed series, and even deploy many workloads with our "click to deploy" capability—or do it yourself from our GitHub repo.

Popular architectures

  • Apache Tomcat with MySQL Database Service
  • Oracle Weblogic on Kubernetes with Jenkins
  • Machine learning (ML) and AI environments
  • Tomcat on Arm with Oracle Autonomous Database
  • Log analysis with ELK Stack
  • HPC with OpenFOAM

See how much you can save with OCI

Oracle Cloud pricing is simple, with consistent low pricing worldwide, supporting a wide range of use cases. To estimate your low rate, check out the cost estimator and configure the services to suit your needs.

Experience the difference

  • 1/4 the outbound bandwidth costs
  • 3X the compute price-performance
  • Same low price in every region
  • Low pricing without long term commitments

Contact sales

Interested in learning more about Oracle Cloud Infrastructure? Let one of our experts help.

  • They can answer questions such as

    • How do I get started with Oracle Cloud?
    • What kinds of workloads can I run on OCI?
    • What types of services does OCI offer?