Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

Docker vllm config for Qwen3-5-122B-A10B-NVFP4

Via r/LocalLlama
Sunday, Mar 22, 2026 · 1:55PM
Summary

In case it helps anyone I'm sharing the config I am using for Qwen3-5-122B-A10B-NVFP4 deployed on a single 6000 Pro. https://github.com/ian-hailey/vllm-docker-Qwen3-5-122B-A10B-NVFP4

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories