Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

235M param LLM from scratch on a single RTX 5080

Via r/LocalLlama
Tuesday, Apr 21, 2026 · 4:32PM
Summary

Hey everyone, Been working on this for a while and figured I'd share it here too. I made a small transformer language model completely from scratch in PyTorch. No pretrained weights, no HuggingFace downloads. Every parameter was trained from raw text on a single consumer GPU. Current release is Plas

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories