Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

I catalogued every way local models break JSON output and built a repair library, here's what I found across 288 model calls

Via r/LocalLlama
Monday, May 11, 2026 · 9:17PM
Summary

I've been running structured output prompts through a bunch of models on OpenRouter for the past few months — Llama 3, Mistral, Command R, DeepSeek, Qwen, and every other model on OpenRouter — alongside the usual closed-source suspects. 288 calls total. I wanted to know what actually breaks, how oft

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories