Best AI News โ€” Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

Kimi K3 full model running on 16x GB10 cluster at 20+tps

Via r/LocalLlama
Tuesday, Aug 4, 2026 ยท 7:56PM
Summary

Kimi K3 full model running on 16x GB10 cluster at 20+tps average (llama-benchy coherent corpus) 38tps peak, 750tps prefill. This is the first run of full k3 with dspark on my cluster. I will be doing some tests and try tp speed this up. As soon as it looks ready I'll publish the vllm image and instr

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories