Tag: multi-token prediction

Google Unleashes Gemma 4: Blazing Fast Inference with Multi-token Prediction

Google's new Gemma 4 uses multi-token prediction drafters to speed up inference massively. Let's see if this is pure hype or a game-changer for AI devs.