Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home→ Community→ Story
Community

llama: avoid copying logits during prompt decode in MTP by am17an · Pull Request #23198 · ggml-org/llama.cpp

Via r/LocalLlama
Sunday, May 17, 2026 · 3:42PM
Summary

time to update your llama.cpp -> improved prompt processing speed

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Related in Community
The power of structured workflows and small local models
r/LocalLlama
MiroThinker-1.7, an open-weight deep research agent (Qwen3 MoE base) — mini is 30B/3B active, curious what tok/s people get on consumer hardware
r/LocalLlama
Made a simple template manager and GUI for llama.cpp so I don't have to keep memorizing CLI flags.
r/LocalLlama
Developers who use local AI - Q4_0 vs Q8_0 KV quant?
r/LocalLlama
MTP for Qwen3.6-35B-A3B on 6GB VRAM laptop: not worth it
r/LocalLlama
More from Best AI News
World Action Models give robots the ability to simulate consequences before they move
The Decoder · Industry & Money
Chatbots at the drive-thru are just the beginning
The Verge AI · Industry & Money
Greg Brockman consolidates OpenAI's product teams to build an "agentic future"
The Decoder · Industry & Money
Mistral CEO Arthur Mensch warns France against letting Anthropic's Mythos scan military code bases
The Decoder · Industry & Money
Back to all stories