Best AI News โ€” Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

FPGAs for speculative decoding

Via r/LocalLlama
Sunday, May 3, 2026 ยท 3:55AM
Summary

Anyone who knows stuff about fpgas: - What max model size can one be designed for (I've read 20-30m parameters max, is it possible to go for more if quantized - at a resonable price)? - Taalas - is what they're doing with asics more viable (rumored? qwen 27b @10k tok/sec at apperantly <$800 hard) Wo

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories