Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

Is there a big gap between Q4 and Q6 on Qwen3.6?

Via r/LocalLlama
Thursday, May 14, 2026 · 6:59PM
Summary

I’ve got one 3090 and thanks to the help of MTP and all, I can do around 65 tok/s on qwen 3.6 dense 27b. But I’m running at Q4_M so everything fits and my context isn’t super high. Maybe 65k or up to 100k. I’ve thrown around the idea of a second 3090. But I do already have some gaming PCs running pa

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories