Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

llama.cpp fixes to run Bonsai 1-bit models on CPU (incl AVX512) and AMD GPUs

Via r/LocalLlama
Thursday, Apr 2, 2026 · 8:40PM
Summary

PrismAI's fork of llama.cpp is broken if you try to run on CPU. This also includes instructions for running on AMD GPUs via ROCm. https://github.com/philtomson/llama.cpp/tree/prism

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories