Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home→ Community→ Story
Community

What settings do you use for running Qwen3.8-Flash-Next in llama.cpp?

Via r/LocalLlama
Wednesday, Sep 9, 2026 · 12:36PM
Summary

Hi, I'm wondering what settings you are using in order to run Qwen3.8-Flash-Next on your devices? I'm especially interested in setups with 96GB VRAM. I'm not quite sure if llama.cpp does offload the embeddings to RAM or disk with my settings. I would like to offload them to RAM in order to avoid too

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories