Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home→ Community→ Story
Community

Tuning Qwen 3.8 27B and OMP as a coding agent on 2× 3090s

Via r/LocalLlama
Saturday, Sep 19, 2026 · 1:25AM
Summary

Oh My Pi + vLLM on two 3090s. Average wait per turn went from 28s to 7s, mostly from changing omp settings: explicit effort level on every role (unset ones defaulted to xhigh) thinking_token_budget of 7500 maxTokens 8k → 32k (file writes were getting cut off) tool output over 10 KB goes to a file ma

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories