Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home→ Community→ Story
Community

FP8/BF16 users seeing someone run IQ1_S

Via r/LocalLlama
Saturday, Oct 3, 2026 · 11:47AM
Summary

https://preview.redd.it/egchx5bap8th1.png?width=746&format=png&auto=webp&s=ab25375dcb6c204400ac8ba9b04497ded4c34e25 Why FP8/BF16 get horrified/disgusted even with FP4/INT4 or Any 4 bit quantisation method?

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Related in Community
Aleph-Alpha/Kolibri-1 · Hugging Face - 78B parameters. 3.46B active. Up to 1M tokens of context - Apache 2.0
r/LocalLlama
Anyworld, a self-hosted multiplayer text RPG where a local LLM is the Dungeon Master
r/LocalLlama
The ultimate guide to multi-harness RL
r/LocalLlama
What are you expectations from Kimi K3.5?
r/LocalLlama
I tried building a small RAG search node for Qwen3.8 27B using a fake AliExpress Mini PC... and Intel sent me back to 2018.
r/LocalLlama
More from Best AI News
Muse Creates Detailed Profiles of All Your Friends and Family
Wired AI · Policy & Culture
Deepmind researchers propose "Artificial Symbiotic Intelligence" as an alternative to the singularity
The Decoder · Industry & Money
Open-source "BootLoops" harness supports AI models in performing precise scientific calculations
The Decoder · Industry & Money
AI agents build 3D scenes from photos but have no idea if they got it right
The Decoder · Industry & Money
Back to all stories