Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

How difficult is distilling?

Via r/LocalLlama
Friday, May 8, 2026 · 8:46PM
Summary

I remember a year or so ago when DeepSeek R1 came out and it was pretty quickly distilled into Llama 3 8b and Qwen 2.5 (?) 7b. Why don’t we see more distilled models? How expensive is it? How many tokens or prompts does it take?

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories