We’re sorry. We could not find a match for your search.

We suggest you try the following to help find what you're looking for:

  • Check the spelling of your keyword search.
  • Use synonyms for the keyword you typed, for example, try "application" instead of "software."
  • Start a new search.
Contact Us Sign in to Oracle Cloud

Graphics Processing Unit (GPU) Instances

OCI Compute provides NVIDIA GPU-based bare metal and virtual machine instances for a variety of use cases, from mainstream graphics and video to the most demanding AI training and HPC workloads. Remote direct memory access (RDMA) communication between instances supports large GPU clusters with 1,600 Gb/sec of bandwidth for workloads such as model training, inference computation, physics-based modeling and simulation, image rendering, and massively parallel HPC applications.

NVIDIA AI Enterprise

NVIDIA’s software suite for a wide range of workflows from data science to inference will further simplify adoption of AI-powered applications. Support for OCI is coming soon.

GPU instances—key features

High-performance NVIDIA GPU instances

NVIDIA Tensor Core GPUs

NVIDIA GPUs are designed to run the same instruction multiple times with different data, helping customers solve complex problems in science, engineering, and business. Oracle’s newest GPU is ideally suited for model training, inference computation, physics and image rendering, and massively parallel applications.

Bare metal performance

Bare metal servers allow customers to run high performance, latency-sensitive, specialized, and traditional workloads directly on server hardware—just as they would on-premises. Bare metal instances are ideal for workloads that need to run in nonvirtualized environments.

RDMA + GPU = massive speed and scale

NVIDIA A100 GPUs utilize Oracle’s low latency cluster networking, based on remote direct memory access (RDMA), running over converged ethernet (RoCE) with latency of less than two microseconds. Customers can host more than 500 GPUs in a cluster and scale on demand.

Choose from optimized VM and bare metal shapes

Range of instance types and configurations

Match your workload with different instance types to find your ideal fit.

  • Select from NVIDIA A10, A100, V100, or P100 GPUs
  • Choose from VMs or bare metal instances
Intel and AMD CPU options

Utilize the CPU architecture you prefer, based on workload demands.

  • Up to 2,048 GB of memory on bare metal
  • Up to 1 PB block storage
  • Networking from 25 Gbps to 8 x 200 Gbps RDMA

Optimal price/performance

Block storage price/performance advantage

Oracle block volumes are 57% less expensive than the competition and delivers performance that meets or exceeds their offerings. Oracle’s straightforward and globally consistent cloud storage pricing has no provisioning charges for standard IOPS usage, and eliminates the need to use complex pricing formulas to forecast spend.

Gain network efficiency

Oracle Cloud networking infrastructure is fast, predictable and inexpensive, offering the lowest data egress charges from a major cloud provider (after offering 10 TB at no charge). For customers with significant data transfer requirements, this results in a huge cost advantage.

Consistent global pricing

Compute, storage, database, and infrastructure prices are the same across the globe, offering savings of 30% or more relative to competitors in some geographies.

Secure cloud infrastructure

Isolated network virtualization

Prevent attacks on customer tenancies with isolated network virtualization. A foundational element of Oracle Cloud infrastructure’s security-first architecture, the design stops malware in its tracks with a custom-designed SmartNIC to isolate and virtualize the network.

Oracle Cloud Infrastructure Identity and Access Management

Using easy-to-define policies organized by logical groups of users and resources, control not only who has access to Oracle Cloud Infrastructure resources but which ones and the access type. Customers manage identities and grant access by leveraging existing organizational hierarchies and federated directory services, including Microsoft, Okta and other SAML directory providers.

Hardware root of trust

Reduce the risk of firmware-based attacks against Oracle Cloud Infrastructure customer tenants with custom-built, hardware-based, root-of-trust-technology designed to wipe and reinstall the firmware every time a new server is provisioned or a new customer tenancy is established.

Oracle Web Application Firewall

Protect applications from malicious and unwanted internet traffic with a cloud-based, PCI-compliant, global web application firewall (WAF) service. By combining threat intelligence with consistent rule enforcement, this service strengthens defenses and protects internet-facing application servers.

Oracle Cloud Infrastructure Vault

Centrally manage and maintain control of the encryption keys and secret credentials used to protect enterprise data and access resources. The security for both are stored in Federal Information Processing Standards (FIPS) 140-2, Level 3-certified, hardware security module (HSM).

Users can further control permissions for individual keys and vaults with Oracle Cloud Infrastructure Identity and Access Management, and monitor key lifecycle with Oracle Audit to meet enhanced compliance requirements.

Choice of operating systems and application images

Choose from popular operating systems

Oracle supports an extensive list of Microsoft Windows Server and enterprise Linux operating systems, including Oracle Linux, CentOS, Ubuntu, and many others. Oracle Autonomous Linux is a free, autonomous operating environment that reduces complexity and human error to deliver increased cost savings, security and availability.

Automate operating system management

The OS Management service allows customers to set policies for automated updates and patches for their operating system environment.

View documentation

Bring your own image (BYOI)

Customers can run their own operating systems and hypervisors on Oracle compute instances and use the same image across configuration sizes.

NVIDIA GPU Cloud

Access 100’s of GPU-optimized applications for deep learning, machine learning, and high- performance computing that covers all industries and workloads.

Explore NVIDIA GPU Cloud

Leverage Oracle Cloud Marketplace

Access software and disk images

Oracle Cloud Marketplace provides software and disk images for data science, analytics, artificial intelligence (AI), and machine learning (ML) models so customers quickly gain insight from their data.

NVIDIA GPU Cloud

Access hundreds of GPU-optimized applications for machine learning, deep learning, and high- performance computing covering a wide range of industries and workloads. Learn more.

NVIDIA Quadro Virtual Workstation

Customers can deliver powerful workstation performance wherever employees need it by running the NVIDIA Quadro Virtual Workstation on Oracle Cloud.

Microservices and containers

Container registry

Developers building applications using containers leverage a highly available, Oracle-managed private container registry service for storing and sharing container images. Push or pull Docker images to and from the registry using the Docker V2 API and the standard Docker command line interface (CLI). Images can be pulled directly into a Kubernetes deployment.

Oracle Functions

Functions as a service (FaaS) lets developers run serverless applications that integrate with Oracle Cloud Infrastructure, Oracle Cloud Applications, and third-party services. Gain developer efficiency along with the community of the open source Fn Project.

Talk with Oracle about accelerating your GPU workloads.

GPU instances—use cases

  • Streamline computer-aided engineering (CAE) and computational fluid dynamics (CFD)

    Altair’s UltraFluidX, nanoFluidX, and Hyperworks CFD solvers leverage GPU instances to provide fast prediction of aerodynamic properties of vehicles, buildings, and other complex flow simulations at scale.

    Learn more about Altair’s solutions

  • Rapidly produce 3D renderings

    YellowDog delivers computer generated image rendering for complex 3D projects and top animated movies. With Oracle Bare Metal, they saw 9.8x faster rendering performance vs AWS.

    Learn how YellowDog got 10x faster

  • Virtualization for creative and technical professionals

    Customers deliver powerful workstation performance wherever employees need it by running the NVIDIA Quadro Virtual Workstation on Oracle Cloud.

    Find NVIDIA Quadro Virtual Workstation on Oracle Marketplace

    Learn more about Quadro Virtual Workstation

See how OCI and NVIDIA power next-generation AI models

National Grid analyzes weather 40% better on Oracle Cloud

“Oracle Cloud Infrastructure allows us to process tens of thousands of models, so we can train our algorithms very quickly. It’s one of the best platforms in the world for the type of work we do.”

James Kelloway, Energy Intelligence Manager
National Grid ESO

Aleph Alpha builds self-learning artificial intelligence on OCI

“This is a new generation model, and in order to train those you need a new generation of hardware—the old GPU clusters aren’t sufficient anymore. On the industry side we have raised a lot of capital and partnered with Oracle. We’re building a way to translate an impressive playground task into an enterprise application that creates value.”

Jonas Andrulis, Founder and CEO
Aleph Alpha

WEKA on OCI delivers 2 terabytes per second performance

“Oracle Cloud Infrastructure is a top tier Hyperscaler cloud that provides XaaS compute and application services to Oracle customers, and offers a lot more than you might expect, including AI/ML and GPU workloads.”

Joel Kaufman
Senior Technical Marketing Manager, WEKA

Tango Eye serves more customers at lower cost with Oracle

“Since moving off AWS, we have quadrupled our data footprint while reducing our costs by 40%. We use 33% less GPU compute capacity on OCI than AWS.”

Suren Gounder, CEO
Tango Eye

Altair tests and runs complex simulations overnight on OCI

“The integration with Oracle’s cloud platform provides us with state-of-the-art GPU compute resources, world-class security, and highly flexible VMware environments. Ultimately, this leads to improved productivity, optimized resource utilization, and faster time to market.”

Sam Mahalingam, Chief Technology Officer
Altair

GPU specifications and pricing

GPU Instances Specifications

Instances are available as virtual machines and bare metal, providing flexibility and high performance.

Shape
GPUs
Architecture
GPU Interconnect
GPU Memory
CPU Cores
CPU Memory
Storage
Network
GPU Price Per Hour (US$)
Server Price Per Hour (US$)
Large Scale-out AI Training
BM.GPU.GM4.8
(new)
8x NVIDIA A100 80GB Tensor Core
Ampere
NVIDIA NVLINK
640 GB
128
2,048 GB
4x 6.8TB NVMe
8x2x100 Gb/sec RDMA*

$32
BM.GPU4.8
8x NVIDIA A100 40GB Tensor Core
Ampere
NVIDIA NVLINK
320 GB
64
2,048 GB
4x 6.8TB NVMe
8x2x100 Gb/sec RDMA*

$24.4
Small AI Training, Inference, Streaming, Gaming, VDI
VM.GPU.GU1.1
(coming soon)
1x NVIDIA A10 Tensor Core
Ampere
N/A
24 GB
15
240 GB
Block storage
24 Gb/sec

$2
VM.GPU.GU1.2
(coming soon)
2x NVIDIA A10 Tensor Core
Ampere
N/A
48 GB
30
480 GB
Block storage
48 Gb/sec

$4
BM.GPU.GU1.4
(new)
4x NVIDIA A10 Tensor Core
Ampere
N/A
96 GB
64
1,024 GB
2x 3.84TB NVMe
2x50 Gb/sec

$8
VM.GPU3.1
1x NVIDIA V100 Tensor Core
Volta
N/A
16 GB
6
90 GB
Block storage
4 Gb/sec

$2.95
VM.GPU3.2
2x NVIDIA V100 Tensor Core
Volta
NVIDIA NVLINK
32 GB
12
180 GB
Block storage
8 Gb/sec

$5.9
VM.GPU3.4
4x NVIDIA V100 Tensor Core
Volta
NVIDIA NVLINK
64 GB
24
360 GB
Block storage
25 Gb/sec

$11.8
BM.GPU3.8
8x NVIDIA V100 Tensor Core
Volta
NVIDIA NVLINK
128 GB
52
768 GB
4x 1.92TB NVMe
2x 25 Gb/sec

$23.6
VM.GPU2.1
1x NVIDIA P100
Pascal
N/A
16 GB
12
72 GB
Block storage
8 Gb/sec

$1.28
BM.GPU2.2
2x NVIDIA P100
Pascal
N/A
32 GB
28
192 GB
Block storage
2x 25 Gb/sec

$2.55
  • *Each NVIDIA A100 node has eight 2-100 Gb/sec NVIDIA ConnectX SmartNICs connected through OCI’s high-performance cluster network blocks, resulting in 1,600 Gb/sec of bandwidth between nodes.
October 19, 2022

Announcing new capabilities for radically simple cloud infrastructure

Greg Pavlik, Senior Vice President, Oracle

Core cloud infrastructure may seem, at first glance, to be rather plain. Like the engine of your car, its purpose is to get the job done, consistently and quietly. But, just as our automobile engines have been evolving from gasoline-powered to hybrid and electric motors…

Read the complete post

Get started with virtual machines and bare metal


Oracle Cloud Free Tier

Build, test, and deploy applications on Oracle Cloud—for free. Sign up once, get access to two free offers.


Oracle Cloud Infrastructure Platform Overview

Improve performance and security while reducing costs for your performance-intensive and enterprise applications.


Cloud Training—Oracle Cloud Infrastructure

Explore cloud training resources with Oracle Cloud Infrastructure training videos, self-paced learning labs, and certifications.


Explore Oracle Cloud Infrastructure

Oracle Cloud Infrastructure combines the elasticity and utility of the public cloud with the control, security, performance, and predictability of on-premises computing environments.