Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

I built a transformer in C++17 from scratch — no PyTorch, no BLAS, no dependencies. Trains on CPU. 0.83M params, full analytical backprop, 76 min to val loss 1.64.

Via r/LocalLlama
Saturday, May 2, 2026 · 6:11PM
Summary

For the past few months I've been working on Quadtrix.cpp — a complete GPT-style language model implemented in C++17. No PyTorch. No LibTorch. No BLAS. No auto-differentiation library of any kind. The only dependency is the C++17 standard library and POSIX sockets. Repo: https://github.com/Eamon2009

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories