Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

RDMA Mac Studio cluster - performance questions beyond generation throughput

Via r/LocalLlama
Friday, Mar 27, 2026 · 6:15AM
Summary

Jeff Geerling’s RDMA cluster benchmarks showed great generation throughput (31.9 tok/s on 4 nodes for Qwen3 235B), but I have questions about other performance aspects. Anyone with an RDMA cluster setup: Prefill speed - Prompt processing at 32K/64K/128K context. Single node vs clustered. Does aggreg

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories