Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

I run 35B–480B coding models on my 36 GB MacBook by streaming MoE experts from SSD — self-contained app, and I publish the benchmarks that *failed* too

Via r/LocalLlama
Saturday, Jul 25, 2026 · 5:42PM
Summary

I got tired of "your Mac can't run that" so I forked llama.cpp to stream a MoE model's expert weights from SSD instead of forcing the whole thing into RAM. A MoE only fires a few experts per token, so most weights sit idle — Slipstream keeps the always-needed weights resident and streams the routed

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories