Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

PSA for DeepSeek-V4-Flash-0731 users — don't blow out your prompt cache with system role messages mid-conversation

Via r/LocalLlama
Sunday, Aug 2, 2026 · 7:24AM
Summary

DSv4F doesn't ship a jinja, but for distributions that do and faithfully reconstruct what DS releases in their chat template python, every system message is hoisted into the system prompt at the top -- the format has no mid-conversation system turn. So, anything you stick at the tail or mid-convo ac

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories