Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

SFT + DPO on open-sourced SLMs

Via r/LocalLlama
Friday, Apr 17, 2026 · 3:01PM
Summary

Hey folks, this is for those who appreciate experimentation on open-sourced AI models. We fine-tuned open-sourced SMLs (3B and 7B parameters) with SFT + DPO against commercial models like GPT-5.4, Gemini 3.1 Pro, Claude Opus 4.6, Google Document API, and open-source alternatives like OlmOCR, Deepsee

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories