Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

gemma4 QATs vs higher-bit regular quantizations?

Via r/LocalLlama
Wednesday, Jun 10, 2026 · 2:28AM
Summary

I have enough RAM+VRAM to use gemma4 26b a4b up to q6_k quantizations w/ decent performance. Does anyone have any comparisons of the Q4_0 QATs (at 4-bits/wt) vs non-QATs at >4 bits/wt? (ex: q6_K)? KLD vs the originals wouldn't be appropriate IIUC.

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories