Best AI News โ€” Updated Every 3 Hours
Story Page
← All Stories
Home→ Community→ Story
Community

I pushed Qwen3.8-27B to 124 tps on a single request on a RTX 3090

Via r/LocalLlama
Tuesday, Aug 18, 2026 ยท 5:35PM
Summary

Two days ago I released a hyper-optimized Qwen3.8-27B inference engine for an RTX 3090 (82 tps single request, 672 peak) - yesterday's update took that to 99 tps single-user / ~1,000 tps at 64 concurrent. Since then I've focused on the single-request number, again without quality degradation. It's n

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories