Best AI News โ€” Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

The use Q8 a waste of resources?

Via r/LocalLlama
Sunday, May 3, 2026 ยท 2:35AM
Summary

I can run G4 31B Q8 XL with ctx 75k and Gwen's 27B and 35B Q8 XL ctx 145k, but I'm wondering if I'm wasting GB of SSD and VRAM. Is it worth upgrading to Q6 K? To save disk space and gain a little more T/s and more context? Or does intelligence deteriorate significaly "Kld" or "kl"? Is Vision affecte

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories