File storage for high performance computing in the cloud
High-performance computing (HPC) is becoming more and more common as AI, machine learning, engineering simulations, and financial modeling applications are used by more companies. Advancements in recent years have made high performance computing on the cloud possible, easily accessible, and affordable.
However, according to a recent Oracle Cloud Infrastructure blog post, shared file system throughput for compute clusters is often a barrier for simulations, artificial intelligence and machine learning, and complex modeling.
“We can provide this level of performance because our block storage is backed by NVMe SSD media and our data centers have a fast, flat network architecture. We believe so strongly in the capabilities of our storage offering that our block storage performance is backed by a unique performance SLA. Throughput varies by the size of the volume, and all volumes 1 TB and above provide the maximum 480 MB/s on the balanced performance tier, by default and at no additional charge.”
This type of storage requires the manual creation of file server clusters with cloud compute instances with direct-attached solid state drives, but provides the highest levels of performance – highest throughput and lowest latency—which is required for these HPC applications.