Best AI News โ€” Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

Karpathy's MicroGPT running at 50,000 tps on an FPGA

Via r/LocalLlama
Sunday, May 3, 2026 ยท 1:54AM
Summary

Sure, it's only 4,192 parameters, but it's a start. Project write-up here: https://v2.talos.wtf/ and github repository here: https://github.com/Luthiraa/TALOS-V2 Some of the speed comes from having the weights onboard, rather than in external memory. Onboard ROM means with 16 bit weights current FPG

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories