Modal Labs has adopted Oracle Cloud Infrastructure (OCI) to enhance the efficiency of inferencing, fine-tuning, and batch processing for its customers. By leveraging OCI, Modal Labs gains access to various OCI Compute bare metal instances known for their considerable price-performance benefits.
Erik Bernhardsson, founder and CEO of Modal, emphasized OCI’s advantages. “OCI provides the scale and performance we need to run large AI workloads faster, without incurring excessive compute costs,” he said. “Oracle is hard to beat when it comes to price, performance, and the level of support it provides. With Modal on OCI, our customers can scale up hundreds of nodes and down to zero within seconds, while only paying for what they use and reducing their reliance on fragmented solutions.”
Modal accelerates the development and deployment of AI models by allowing data and engineering teams to run code in the cloud without configuring or setting up the necessary infrastructure. This platform is particularly beneficial for developers utilizing generative AI to create new applications, such as composing music or designing novel protein structures. Fast and reliable GPUs from OCI facilitate these activities. Developers working on Modal can ship code, get AI models into production, and test applications more swiftly.
Mahesh Thiagarajan, executive vice president of Oracle Cloud Infrastructure, discussed common challenges in AI deployment. “A lack of technology infrastructure and GPU availability often leads to a loss in production and higher costs for organizations trying to deploy AI,” he stated. “OCI AI infrastructure provides the highest-tier performance and value for all AI workloads across Oracle’s distributed cloud, so customers can easily deploy AI infrastructure wherever they need it.”
OCI AI infrastructure is designed to enhance AI deployments by offering high-performance capabilities that can handle demanding AI workloads. OCI bare metal GPU instances are equipped to power applications such as natural language processing, computer vision, and recommendation systems. Additionally, Oracle’s dedicated engineering support team collaborates with customers from planning to launch, ensuring the success of AI initiatives.
Through OCI’s infrastructure, Modal Labs has seen significant performance improvements. This innovation helps Modal meet the diverse demands of developers building on its platform, improving the overall user experience and outcomes.
