Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home→ Community→ Story
Community

Improved TPS of Gemma 4 31B : the journey and also creating custom patches with VLLM fork

Via r/LocalLlama
Saturday, Sep 19, 2026 · 8:38PM
Summary

I improved the TPS of Gemma 4 31B. Improving TPS and performing optimisations requires understanding of the model architecture, and I had to fork VLLM and apply my own patch to break into making a configuration work as per my idea. I wrote a full article so that even beginners can understand and imp

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories