Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

2 old RTX 2080 Ti with 22GB vram each Qwen3.6 27B at 38 token/s with f16 kv cache

Via r/LocalLlama
Friday, May 15, 2026 · 11:48AM
Summary

PLEASE KEEP IN MIND BOTH OF MY CARDS ARE POWER LIMITED TO 150W (i hate noise) ------- Just wanted to share my current setup, that might help some users out there... services: llama-server: image: ghcr.io/ggml-org/llama.cpp:full-cuda12-b9128 container_name: llama-server restart: unless-stopped ports:

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories