Best AI News โ€” Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

GGUF Quants Arena for MMLU (24GB VRAM + 128GB RAM)

Via r/LocalLlama
Thursday, Apr 16, 2026 ยท 9:38AM
Summary

Dataset: MMLU subset (DEV+TEST) Llamacpp setting: 3 params only ctx 8192 , seed 42 , fa on Let me know whatelse do you want to see. Thanks. Results: Qwen3.5-27B-UD-Q5_K_XL.gguf 87.33% 12263/14042 Qwen3.5-27B-UD-Q4_K_XL.gguf 87.25% 12252/14042 Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled.i1-Q4_K_M

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories