OCI Compute provides NVIDIA GPU-based bare metal and virtual machine instances for a variety of use cases, from mainstream graphics and video to the most demanding AI training and HPC workloads. Remote direct memory access (RDMA) communication between instances supports large GPU clusters with 1,600 Gb/sec of bandwidth for workloads such as model training, inference computation, physics-based modeling and simulation, image rendering, and massively parallel HPC applications.
NVIDIA GPU Cloud Machine Image on OCI is certified and supported with NVIDIA AI Enterprise, a fully managed, secure, and cloud native suite of AI and data analytics software.
NVIDIA GPUs are designed to run the same instruction multiple times with different data, helping customers solve complex problems in science, engineering, and business. Oracle’s newest GPU is ideally suited for model training, inference computation, physics and image rendering, and massively parallel applications.
Bare metal servers allow customers to run high performance, latency-sensitive, specialized, and traditional workloads directly on server hardware—just as they would on-premises. Bare metal instances are ideal for workloads that need to run in nonvirtualized environments.
NVIDIA A100 GPUs utilize Oracle’s low latency cluster networking, based on remote direct memory access (RDMA), running over converged ethernet (RoCE) with latency of less than two microseconds. Customers can host more than 500 GPUs in a cluster and scale on demand.
Match your workload with different instance types to find your ideal fit.
Utilize the CPU architecture you prefer, based on workload demands.
Oracle block volumes are 57% less expensive than the competition and deliver performance that meets or exceeds their offerings. Oracle’s straightforward and globally consistent cloud storage pricing has no provisioning charges for standard input/output operations per second usage and eliminates the need to use complex pricing formulas to forecast spending.
Oracle Cloud networking infrastructure is fast, predictable, and inexpensive, offering the lowest data egress charges from a major cloud provider (after offering 10 TB at no charge). For customers with significant data transfer requirements, this results in a huge cost advantage.
Compute, storage, database, and infrastructure prices are the same across the globe, offering savings of 30% or more relative to competitors in some geographies.
Prevent attacks on customer tenancies with isolated network virtualization. A foundational element of Oracle Cloud Infrastructure’s security-first architecture, the design stops malware in its tracks with a custom-designed SmartNIC to isolate and virtualize the network.
Using easy-to-define policies organized by logical groups of users and resources, control not only who has access to Oracle Cloud Infrastructure resources but which ones and the access type. Customers manage identities and grant access by leveraging existing organizational hierarchies and federated directory services, including Microsoft, Okta, and other SAML directory providers.
Reduce the risk of firmware-based attacks against Oracle Cloud Infrastructure customer tenants with custom-built, hardware-based, root-of-trust-technology designed to wipe and reinstall the firmware every time a new server is provisioned or a new customer tenancy is established.
Protect applications from malicious and unwanted internet traffic with a cloud-based, PCI-compliant, global web application firewall (WAF) service. By combining threat intelligence with consistent rule enforcement, this service strengthens defenses and protects internet-facing application servers.
Centrally manage and maintain control of the encryption keys and secret credentials used to protect enterprise data and access resources. The security for both are stored in Federal Information Processing Standards (FIPS) 140-2, Level 3-certified, hardware security module (HSM).
Users can further control permissions for individual keys and vaults with OCI Identity and Access Management and monitor key lifecycle changes with OCI Audit to meet enhanced compliance requirements.
Oracle supports an extensive list of Microsoft Windows Server and enterprise Linux operating systems, including Oracle Linux, CentOS, Ubuntu, and many others. Oracle Autonomous Linux is a free, autonomous operating environment that reduces complexity and human error to deliver increased cost savings, security, and availability.
The OCI OS Management service allows customers to set policies for automated updates and patches for their operating system environment.
Customers can run their own operating systems and hypervisors on Oracle compute instances and use the same image across configuration sizes.
Oracle Cloud Marketplace provides software and disk images for data science, analytics, artificial intelligence (AI), and machine learning (ML) models so customers can quickly gain insight from their data.
Access hundreds of GPU-optimized applications for machine learning, deep learning, and high performance computing covering a wide range of industries and workloads. Learn more.
Customers can deliver powerful workstation performance wherever employees need it by running NVIDIA RTX Virtual Workstation on Oracle Cloud.
Developers building applications using containers leverage a highly available, Oracle-managed private container registry service for storing and sharing container images. Push or pull Docker images to and from the registry using the Docker V2 API and the standard Docker command line interface (CLI). Images can be pulled directly into a Kubernetes deployment.
Functions as a service (FaaS) lets developers run serverless applications that integrate with Oracle Cloud Infrastructure, Oracle Cloud Applications, and third-party services. Gain developer efficiency along with the community of the open source Fn Project.
Altair’s ultraFluidX, nanoFluidX, and HyperWorks CFD solvers leverage GPU instances to provide fast prediction of aerodynamic properties of vehicles, buildings, and other complex flow simulations at scale.
YellowDog delivers computer-generated image rendering for complex 3D projects and top animated movies. With Oracle bare metal servers, YellowDog can achieve faster turnaround times for customers’ applications.
Customers deliver powerful workstation performance wherever employees need it by running NVIDIA RTX Virtual Workstation on Oracle Cloud.
“Oracle Cloud Infrastructure allows us to process tens of thousands of models, so we can train our algorithms very quickly. It’s one of the best platforms in the world for the type of work we do.”
James Kelloway, Energy Intelligence Manager
National Grid ESO
“We view this relationship with OCI as long term. We’re excited about taking advantage of the GPUs and using that to train our next generation of voice AI. There's a lot that we think that OCI will provide for us in terms of future growth.”
James Hom, Cofounder and Vice President of Products
SoundHound
“Oracle Cloud Infrastructure is a top tier Hyperscaler cloud that provides XaaS compute and application services to Oracle customers, and offers a lot more than you might expect, including AI/ML and GPU workloads.”
Joel Kaufman
Senior Technical Marketing Manager, WEKA
“Since moving off AWS, we have quadrupled our data footprint while reducing our costs by 40%. We use 33% less GPU compute capacity on OCI than AWS.”
Suren Gounder, CEO
Tango Eye
“The integration with Oracle’s cloud platform provides us with state-of-the-art GPU compute resources, world-class security, and highly flexible VMware environments. Ultimately, this leads to improved productivity, optimized resource utilization, and faster time to market.”
Sam Mahalingam, Chief Technology Officer
Altair
Instances are available as virtual machines and bare metal, providing flexibility and high performance.
Shape |
GPUs |
Architecture |
GPU Interconnect |
GPU Memory |
CPU Cores |
CPU Memory |
Storage |
Network |
GPU Price Per Hour (US$) |
Server Price Per Hour (US$) |
Large Scale-out AI Training | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|
BM.GPU.GM4.8 (new) |
8x NVIDIA A100 80GB Tensor Core |
Ampere |
NVIDIA NVLINK |
640 GB |
128 |
2,048 GB |
4x 6.8TB NVMe |
8x2x100 Gb/sec RDMA* |
$32 | |
BM.GPU4.8 |
8x NVIDIA A100 40GB Tensor Core |
Ampere |
NVIDIA NVLINK |
320 GB |
64 |
2,048 GB |
4x 6.8TB NVMe |
8x2x100 Gb/sec RDMA* |
$24.4 | |
Small AI Training, Inference, Streaming, Gaming, VDI | ||||||||||
VM.GPU.GU1.1 (coming soon) |
1x NVIDIA A10 Tensor Core |
Ampere |
N/A |
24 GB |
15 |
240 GB |
Block storage |
24 Gb/sec |
$2 |
|
VM.GPU.GU1.2 (coming soon) |
2x NVIDIA A10 Tensor Core |
Ampere |
N/A |
48 GB |
30 |
480 GB |
Block storage |
48 Gb/sec |
$4 |
|
BM.GPU.GU1.4 (new) |
4x NVIDIA A10 Tensor Core |
Ampere |
N/A |
96 GB |
64 |
1,024 GB |
2x 3.84TB NVMe |
2x50 Gb/sec |
$8 |
|
VM.GPU3.1 |
1x NVIDIA V100 Tensor Core |
Volta |
N/A |
16 GB |
6 |
90 GB |
Block storage |
4 Gb/sec |
$2.95 |
|
VM.GPU3.2 |
2x NVIDIA V100 Tensor Core |
Volta |
NVIDIA NVLINK |
32 GB |
12 |
180 GB |
Block storage |
8 Gb/sec |
$5.9 |
|
VM.GPU3.4 |
4x NVIDIA V100 Tensor Core |
Volta |
NVIDIA NVLINK |
64 GB |
24 |
360 GB |
Block storage |
25 Gb/sec |
$11.8 |
|
BM.GPU3.8 |
8x NVIDIA V100 Tensor Core |
Volta |
NVIDIA NVLINK |
128 GB |
52 |
768 GB |
4x 1.92TB NVMe |
2x 25 Gb/sec |
$23.6 |
|
VM.GPU2.1 |
1x NVIDIA P100 |
Pascal |
N/A |
16 GB |
12 |
72 GB |
Block storage |
8 Gb/sec |
$1.28 |
|
BM.GPU2.2 |
2x NVIDIA P100 |
Pascal |
N/A |
32 GB |
28 |
192 GB |
Block storage |
2x 25 Gb/sec |
$2.55 |
Greg Pavlik, Senior Vice President, Oracle
Core cloud infrastructure may seem, at first glance, to be rather plain. Like the engine of your car, its purpose is to get the job done, consistently and quietly. But, just as our automobile engines have been evolving from gasoline-powered to hybrid and electric motors…
Read the complete postBuild, test, and deploy applications on Oracle Cloud—for free. Sign up once, get access to two free offers.
Improve performance and security while reducing costs for your performance-intensive and enterprise applications.
Explore cloud training resources with Oracle Cloud Infrastructure training videos, self-paced learning labs, and certifications.
Oracle Cloud Infrastructure combines the elasticity and utility of the public cloud with the control, security, performance, and predictability of on-premises computing environments.