Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home→ Community→ Story
Community

Qwen3.8-Flash-Next in llama.cpp vs SGLang vs FreeToken: 35s vs 258s to first token at full context. My findings on new PRs coming to engines.

Via r/LocalLlama
Tuesday, Sep 8, 2026 · 7:26PM
Summary

Hey guys, After my CPU-only to 96GB VRAM test, I tested Qwen3.8-Flash-Next across llama.cpp, SGLang and FreeToken on the same workstation. This time I wanted to see what changes when you keep the hardware and model family fixed, but change the engine, weight format and memory placement. I also teste

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories