Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home→ Community→ Story
Community

snkii/Sori-1B: Audio-Grounded LM Trained From Scratch (No Text-Only Pretraining)

Via r/LocalLlama
Monday, Aug 31, 2026 · 2:48AM
Summary

Sori-1B is a 1B-parameter audio-language model built by a single SNU researcher whose core claim to fame is that its decoder is trained entirely from scratch on audio-paired text — no text-only pretraining, no pretrained-LM initialization — with the idea being that a language model which has only ev

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories