Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

Quick note on sudden performance loss when running GGUFs

Via r/LocalLlama
Friday, May 22, 2026 · 10:44AM
Summary

Had a couple of GGUFs (Qwen3.5-35B-A3B-APEX-I-Quality and an Unsloth model as well) that suddenly displayed erratic performance characteristics (sudden deep dives from 20+ tg/s down to 5 tg/s), turned out both had been damaged, not unlikely during manual embedding of MTP layers (shouldn't touch the

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories