Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

Gemma 4 12b QAT is a regression for my use case, despite all the hype.. Not my main Squeeze

Via r/LocalLlama
Monday, Jun 8, 2026 · 7:33AM
Summary

I spent the last few days trying to get consistent tool calling out of the new Gemma 4 12b QAT model and had to give up. When the model actually works, it works great, but for my specific use case and workflows it is just not for me. It is a major regression compared to the standard Q5_K_L version,

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories