Modal Labs solves AI compute snags for developers with OCI AI Infrastructure
The tech provider gains fast and reliable access to high performance GPUs with OCI AI Infrastructure for rapid training of AI workloads.
“Before working with Oracle, we struggled to find reliable NVIDIA GPU access at scale with the performance that we needed. OCI’s bare metal instances have been phenomenal at delivering value for our customers. We now can deliver the capacity our customers need, often with very short lead times. OCI also gives us the flexibility to offer a variety of shapes that meet developers’ ever-changing requirements.”
Modal Labs offers an infrastructure-as-a-service platform that provides data, AI, and machine learning for developers to build applications faster—from music to biotech research. The startup was recently named to Wing Venture Capital’s Enterprise Tech 30 list of the most promising private tech companies. Modal needs ready access to high performance cloud computing resources to quickly cold start GPUs and containers in serverless environments when launching its customers’ demanding generative AI or large-scale batch jobs. The company chose OCI AI infrastructure to gain fast and reliable access to potentially thousands of high-performance GPUs at one time. The company can now offer a variety of shapes that meet the varying needs of developers, including the use of OCI’s bare metal and VMs with NVIDIA H100, A100, and A10 Tensor Core GPUs.