Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

llama.cpp constantly reprocessing huge prompts with opencode/pi.dev

Via r/LocalLlama
Thursday, May 14, 2026 · 8:11PM
Summary

I’m using llama-swap with llama.cpp. I mainly use opencode + pi.dev and I’m seeing frequent massive prompt reprocessing / prefills even tho the prompts are very similar between requests. Example behavior: context grows to +50k tokens LCP similarity often shows 0.99+ but sometimes n_past suddenly fal

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories