Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

MTP for Qwen3.6-35B-A3B on 6GB VRAM laptop: not worth it

Via r/LocalLlama
Sunday, May 17, 2026 · 1:52PM
Summary

I have an Asus gaming laptop from 2021 that I bought used for 500€ last year. I wanted to see if the recently merged MTP support in llama.cpp is worth using on such a VRAM constrained device for the Qwen3.6-35B-A3B model. So I did some experiments to measure performance with and without MTP. TL;DR:

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories