Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

Biggest model that is capable which can fit under 64 gb vram for the purpose of distillation

Via r/LocalLlama
Saturday, Jun 27, 2026 · 7:48PM
Summary

hi all, I have 64 gb VRAM, and I am looking for biggest model that I can use to distill prefer a reasoning model. even with 12 tokens per second I am happy, a 72 b model can fit in my machine, I have dual r9700, dont have speed but got the memory

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories