Best AI News โ€” Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

Gemma 4 MTP with LlamaCPP

Via r/LocalLlama
Wednesday, May 20, 2026 ยท 8:21AM
Summary

I am running Gemma 4 31B for a project using LlamaCPP. There is no integrated main model + MTP drafter GGUF. And from what I can tell, LlamaCPP was updated to not accept a separate MTP drafter GGUF but instead to use a combined GGUF for main+drafter. So how can I use Gemma 4 31B with MTP on LlamaCPP

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories