Best AI News โ€” Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

DeepSeek-v4-Flash-Mini 54GB GGUF running at ~20.5 t/s

Via r/LocalLlama
Tuesday, Aug 4, 2026 ยท 11:51PM
Summary

Took the REAP adaptation of DeepSeek-V4-Flash (0xSero/DeepSeek-V4-Flash-0731-REAP) along with antirez/deepseek-v4-gguf as inspiration, and decided to see how aggressive we could get with standard quant tricks to create a budget-friendly "Mini" build. For the lulz, naturally. Started with the full 95

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories