Best AI News โ€” Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

How to run Prism Bonsai 27B

Via r/LocalLlama
Wednesday, Jul 15, 2026 ยท 4:59AM
Summary

According to their GitHub, the file needed is the -Q2_0.gguf version, which requires compiling their version of llama.cpp. Easiest way to download is to use huggingface-cli if you have it available: hf download prism-ml/Ternary-Bonsai-27B-gguf --include "*-Q2_0.gguf*" If not, just download the file

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories