Best AI News โ€” Updated Every 3 Hours
Story Page
← All Stories
Home→ Community→ Story
Community

How I made DeepSeek V4 Flash 12x faster on an M3 Ultra

Via r/LocalLlama
Wednesday, Aug 19, 2026 ยท 12:48AM
Summary

I work with a Mac Studio M3 Ultra (512GB) serving DeepSeek V4 Flash on antirez/ds4 ("DwarfStar"). A chat turn took between 6 and 20 seconds. Now it takes 1.6s. Kernels (+21% cold prefill at 64k, bit-exact). DeepSeek V4's sparse attention runs a "lightning indexer" that dominates long-context prefill

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories