Today, AWS has announced the introduction of NVIDIA GPU Time-slicing support for Bottlerocket, the Linux-based operating system purpose-built for hosting containers, with a focus on security, minimal footprint, and safe updates. This new feature addresses the challenge of maximizing GPU utilization in multi-tenant and resource-constrained environments by enabling more efficient GPU resource sharing for Artificial Intelligence/Machine Learning (AI/ML) workloads running on containers.
By dividing the GPU’s processing time into smaller intervals or “slices,” Bottlerocket’s support of Time-slicing allows multiple tasks to access a single GPU concurrently. This enables Bottlerocket customers to run multiple AI/ML models on a single GPU, improving GPU utilization and allowing them to scale their workloads more effectively.
GPU Time-slicing on Bottlerocket is now available in all commercial and AWS GovCloud (US) Regions. To learn more about Bottlerocket’s GPU Time-slicing feature, please visit the Bottlerocket developer website.
Source:: Amazon AWS