Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home→ Community→ Story
Community

A 124B emitted 15,128 tokens in a single response on one DGX Spark, decode went 35.62 → 35.68 tok/s across the whole thing

Via r/LocalLlama
Thursday, Aug 13, 2026 · 4:12PM
Summary

Throughput observation more than a demo. Box and recording are sudoingX's on X, shared with his okay; I work on Ling at inclusionAI. He handed the web UI on his llama-server a 33-token prompt — build a gpu monitoring dashboard frontend, dummy data, premium design — and left it running. Ling-3.0-flas

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories