Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

How do I use MTP?

Via r/LocalLlama
Tuesday, May 12, 2026 · 12:16PM
Summary

Hi, I'm trying to use MTP with llama.cpp, I built from source the mtp-pr, download an MTP model from huggingface https://huggingface.co/unsloth/Qwen3.6-27B-GGUF-MTP/resolve/main/Qwen3.6-27B-Q6_K.gguf But when I run the model I have an error: error while handling argument "--spec-type": unknown specu

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories