Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

Best RTX Pro 6000 vllm settings?

Via r/LocalLlama
Thursday, Apr 30, 2026 · 10:48PM
Summary

Just got myself (for my company) a RTX Pro 6000 Blackwell Workstation card. Managed to get really good TPS on qwen3 27b fp8. Using it for many agents that specialize on one specific task at a time. Trying to get the best possible Speed + Concurrency running on vllm 0.20.1 nightly cuda 13.1. Engine 0

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories