Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

Help my llm isn't llming

Via r/LocalLlama
Sunday, Apr 12, 2026 · 8:09AM
Summary

Long story short, for some reasons Q4 and Q6 seem to be taking the same amount of RAM on my Macbook air M2 16GB? And also the same generation speed? I'm a beginner with little knowledge about this, and I hope some kind souls here can save me. here are some stats. models: unsloth Qwen3.5 9B UD-Q4_K_X

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories