Memory-Enforced GPU Sharing in Kubernetes with NVIDIA CUDA 13.4
NVIDIA Technical Blog ·
Many AI workloads need only a fraction of a GPU. Giving each one an entire device can leave capacity idle; sharing GPUs lets platform teams serve more workloads... Many AI workloads need only a fraction of a GPU.