Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home→ Community→ Story
Community

CUDA: fuse shared experts into MMVQ by am17an · Pull Request #29184 · ggml-org/llama.cpp

Via r/LocalLlama
Friday, Oct 2, 2026 · 6:47PM
Summary

MoE speedup, but only for some MoE architectures (like Qwen 35B A3B)

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Related in Community
Should we plead opensource labs to still produce great non thinking (instruct) models?
r/LocalLlama
New Architecture from Percepta: Spotlight — separating intelligence from memory, allowing knowledge and skills to grow without changing the model's weights.
r/LocalLlama
Heavily quantized Qwen3.8-Flash vs Q8 Qwen3.8-27B - thoughts?
r/LocalLlama
I made my iPhone a second GPU for my 24 GB MacBook: Qwen 3.8 27B prefills 29–44% faster & my holds part of the CTX window.
r/LocalLlama
New 64GB DGX Spark. Significantly higher price for the original 128GB model $6,950 USD
r/LocalLlama
More from Best AI News
Cloudflare says its new Clef model means humans no longer need to be in the loop for AI agents
The Decoder · Industry & Money
Apple says it’s tightening macOS ‘Full Disk Access’ controls due to new risks from AI agents
TechCrunch AI · Industry & Money
OpenAI’s Dot agent is enterprise software that can also order your dinner
The Verge AI · Industry & Money
Call it AI, call it Super Intelligence, only 2% of consumers are buying it
TechCrunch AI · Industry & Money
Back to all stories