Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

Qwen3.6 27b q5_k_M MTP - 256k context - 5090

Via r/LocalLlama
Tuesday, May 12, 2026 · 11:43AM
Summary

https://preview.redd.it/ktg0lr3e0p0h1.png?width=1279&format=png&auto=webp&s=d110580662a5c707038b7e2e4f5226d2a18c7bfe Straight to it: llama-server-mtp \ -m ~/models/Qwen3.6-27B-Q5_K_M-mtp.gguf \ --spec-type mtp \ --spec-draft-n-max 3 \ --cache-type-k q8_0 \ --cache-type-v q8_0 \ -np 1 \ -c 262144 \ -

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories