Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

New Bartowski Gemma 4 quants are a lot slower?

Via r/LocalLlama
Saturday, Apr 11, 2026 · 12:22AM
Summary

Bartowski has uploaded new quants for Gemma 4. I've downloaded them for 26B and E4B. Compared to his original release I'm getting about half the tg/s for both of them. 75% of the pp/s. Does anyone know what changed? I'm assuming the weights aren't the problem but maybe the gguf header now enables a

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories