Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

Anyone seen benchmarks comparing Gemma 4 4-bit QAT vs. 8-bit standard quants?

Via r/LocalLlama
Tuesday, Jun 9, 2026 · 5:08AM
Summary

I'm trying to find out if anyone has done any benchmarking comparing the Gemma 4 4-bit QAT models (via Unsloth) against standard 8-bit non-QAT quants. I know QAT is supposed to retain a ton of accuracy compared to the baseline BF16, but I'm curious how a 4-bit QAT model actually fares against a trad

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories