"What do you guys even use local LLMs for?" Me: A lot
Via r/LocalLlama
Wednesday, Apr 29, 2026 · 10:31PM
Summary
Created separate private API keys for each service within LiteLLM and started logging the usage via Prometheus to view in Grafana. Surprised the Frigate GenAI summaries tokens quickly add up! This view is only the past 6 hours.
