Microsoft debuts multichiplet Maia 300 inference accelerator
AI Summary
today pulled back the curtains on Maia 300, its newest internally developed artificial intelligence accelerator. The chip is optimized for inference. Microsoft estimates that it can process 40% more tokens per megawatt than “leading GPU-based systems,” which is likely a reference to Nvidia Corp.
Discussion
Sign in to join the discussion.
Loading comments…