Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

QAT variant of Gemma4 26B A4B is not working well for me

Via r/LocalLlama
Sunday, Jun 7, 2026 · 5:29PM
Summary

I am using llama.cpp version b9549 with this arguments as recommended: llama-server --temp 1.0 --top-p 0.95 --top-k 64 -hf ... Here is what I got on chessboard svg test https://www.reddit.com/r/LocalLLaMA/comments/1t53dhp/quality_comparison_between_qwen_36_27b/ google/gemma-4-26B-A4B-it-qat-q4_0-ggu

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories