llama.cpp fixes to run Bonsai 1-bit models on CPU (incl AVX512) and AMD GPUs
Via r/LocalLlama
Thursday, Apr 2, 2026 · 8:40PM
Summary
PrismAI's fork of llama.cpp is broken if you try to run on CPU. This also includes instructions for running on AMD GPUs via ROCm. https://github.com/philtomson/llama.cpp/tree/prism