Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

Tiny LLM Benchmark: Jetson Orin Nano Super 8GB - Four Power Modes × Eight Models

Via r/LocalLlama
Tuesday, Jun 2, 2026 · 12:56PM
Summary

Just released a deep benchmark of 8 tiny LLMs (135M → ~1B) on a $250 Jetson Orin Nano Super 8GB using llama.cpp CUDA - across all 4 power modes: 7W, 15W, 25W, and MAXN Hardware: NVIDIA Ampere GPU - 1024 CUDA cores, 32 Tensor cores 6× Arm Cortex-A78AE CPU @ 1.728 GHz 8 GB LPDDR5 @ 204.8 GB/s (unified

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories