Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

1-bit and 1.58 bit LLM Benchmarking on Jetson Orin Nano Super | Bonsai LM

Via r/LocalLlama
Wednesday, Jun 10, 2026 · 1:02PM
Summary

Bonsai LM (1-bit and 1.58-bitLLMs) benchmark on Jetson Orin Nano Super Just released a deep benchmark of 5 Bonsai LM models (1.7B → ~8B) on a $250 Jetson Orin Nano Super 8GB using llama.cpp CUDA - across all 4 power modes: 7W, 15W, 25W, and MAXN A thread! So, Bonsai LM models are new line of 1-bit L

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories