Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

Built a fully offline suitcase robot around a Jetson Orin NX SUPER 16GB. Gemma 4 E4B, ~200ms cached TTFT, 30+ sensors, no WiFi/BT/cellular. He has opinions.

Via r/LocalLlama
Friday, May 15, 2026 · 3:09PM
Summary

Sparky runs entirely on the Jetson. Gemma 4 E4B at Q4_K_M via llama.cpp with q8_0 KV cache and flash attention. 12K context, native system role, sampler defaults from the model card. Cached TTFT around 200ms, sustained 14-15 tok/s. SenseVoiceSmall for STT, Piper for TTS with 43Hz mouth sync, PixiJS

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories