From Host Node To Heterogeneous Rack: Rethinking The AI CPU

AI infrastructure is entering a crucial new phase. The first phase of generative AI infrastructure was defined by accelerator scale: how many GPUs, NPUs or custom AI accelerators could be deployed, powered, cooled and connected. That phase is not over, but it is no longer sufficient. The next phase is about rack-scale system composition: heterogeneous AI racks where different compute resources are optimized for different phases of the agentic AI workflow. Specialized racks of CPUs, accelerators,