Dense vs. MoE Models: Active Parameters, Throughput, and When to Choose Each
AI Summary
How can a 30B-parameter model activate only 3B parameters per token, and still use the capacity of the larger model? Nemotron 3.5 Lightning illustrates the... How can a 30B-parameter model activate only 3B parameters per token, and still use the capacity of the larger model?
Discussion
Sign in to join the discussion.
Loading comments…