Google’s latest trick gets Gemma 4 running 3x faster right on your phone
AI Summary
Credit: Google TL;DR Google has introduced new assistant models, called “drafters,” that could significantly speed up Gemma 4. Drafters work by predicting sections of prompts to the main model, which can focus on processing them in bigger batches. This allows the model to use the memory and the compute more efficiently.
Discussion
Sign in to join the discussion.
Loading comments…