Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

llama.cpp - how to free up even more space on your GPU

Via r/LocalLlama
Wednesday, Jun 17, 2026 · 6:23PM
Summary

For the past week or two, llama.cpp has been working much better from the RAM usage prespective. I no longer see any memory leaks, and everything fits nicely on the GPU - my defaults are --n-gpu-layers 99 --no-mmap --mlock to avoid using the regular RAM, since I use my 3090 with an eGPU setup: Qwen3

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories