Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home→ Community→ Story
Community

RTX 5080 with 16 GB VRAM, 64 GB RAM best quantized model for programming?

Via r/LocalLlama
Saturday, May 2, 2026 · 3:55PM
Summary

I have an RTX 5080 with 16 GB of VRAM and 64 GB of RAM. What's the best quantized model I can run locally on this setup for agentic programming?

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Related in Community
I built a transformer in C++17 from scratch — no PyTorch, no BLAS, no dependencies. Trains on CPU. 0.83M params, full analytical backprop, 76 min to val loss 1.64.
r/LocalLlama
Warpdrv - my open-source Llama.cpp launcher for daily-driving Qwen 35b + 27b on Strix Halo + RTX Pro.
r/LocalLlama
Bruh
r/LocalLlama
Qwen 3.6 wins the benchmarks, but Gemma 4 wins reality. 7 things I learned testing 27B/31B Vision models locally (vLLM / FP8) side by side. Benchmaxing seems real.
r/LocalLlama
Kv cache quantization: ignorance, or malice?
r/LocalLlama
More from Best AI News
The best AI dictation apps, tested and ranked
TechCrunch AI · Industry & Money
Even the latest AI models make three systematic reasoning errors, ARC-AGI-3 analysis shows
The Decoder · Industry & Money
xAI's new Custom Voices feature turns a minute of speech into a usable voice clone
The Decoder · Industry & Money
Nvidia CEO Jensen Huang calls out tech leaders' "god complex" over reckless AI job loss predictions
The Decoder · Industry & Money
Back to all stories