Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

Standard LoRA is quietly losing 68% of quality on FP8 hardware and most people have no idea

Via r/LocalLlama
Friday, Mar 27, 2026 · 11:48AM
Summary

FP8 (E4M3) minimum representable value is 0.0625. Standard LoRA default scaling falls below that. Gradient updates underflow to zero, adapter weights freeze, run looks completely normal. You've lost 68% of model quality and had no idea. Not bad luck. Predictable given parameters that predate FP8 har

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories