Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home→ Community→ Story
Community

Trained a ~20K LM (probably smallest) that can still write stories

Via r/LocalLlama
Wednesday, Oct 7, 2026 · 6:10AM
Summary

I’ve been pushing TinyStories-style models downward in size, and this is the smallest one so far: MacroStories — 19,969 parameters, 81 KB FP32 https://huggingface.co/raincandy-u/MacroStories For scale: → ~50× smaller than the 1M TinyStories model → ~3,000× smaller than AlexNet → 32-dim hidden state

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories