Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

Qwen 3.6 27B BF16 vs Q4_K_M vs Q8_0 GGUF evaluation

Via r/LocalLlama
Tuesday, Apr 28, 2026 · 12:18PM
Summary

Evaluated Qwen 3.6 27B across BF16, Q4_K_M, and Q8_0 GGUF quant variants with llama-cpp-python using Neo AI Engineer. Benchmarks used: HumanEval: code generation HellaSwag: commonsense reasoning BFCL: function calling Total samples: HumanEval: 164 HellaSwag: 100 BFCL: 400 Results: BF16 HumanEval: 56

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories