Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home→ Community→ Story
Community

Imbalanced VRAM usage between two GPUs in llama.cpp. Anyone successfully solve this?

Via r/LocalLlama
Sunday, Sep 27, 2026 · 8:18PM
Summary

There is always at least 1+GB of VRAM not usable not matter how I set the --tensor-split (-ts) param. I tiny shift toward one side will move the weight significantly to the other side. 😵‍💫 Adjusting context will increase/decrease usage on both side. --tensor-split 499,501 = GPU1 12.5 GB, GPU2 15.4 G

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories