Foundations of Power Management in the Age of AI

In an AI datacenter, 50 mV of voltage margin can be worth about 270 racks of compute per gigawatt of input electricity. To show how, this paper models two facilities that run the same Vera Rubin NVL72 racks at the same clock speeds, one at 0.80 V and one at 0.75 V. On published Vera Rubin power figures, the second draws about 8% less power per GPU and about 17 kW less per rack. Margin is the supply voltage added above what the silicon needs to cover the worst-case voltage droop. Evolving AI work