Best AI News โ€” Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

Speed difference on Gemma 4 26B-A4B between Bartowski Q4_K_M and Unsloth Q4_K_XL

Via r/LocalLlama
Saturday, Apr 4, 2026 ยท 9:45AM
Summary

I've noticed this on Qwen3.5 35B before as well, there is a noticeable speed difference between Unsloth's Q4_K_XL and Bartowski's Q4_K_M on the same model, but Gemma 4 seems particularly harsh in this regard: Bartowski gets 38 tk/s, Unsloth gets 28 tk/s... everything else is the same, settings wise.

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories