Best AI News โ€” Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

Open-source single-GPU reproductions of Cartridges and STILL for neural KV-cache compaction [P]

Via r/MachineLearning
Monday, Apr 20, 2026 ยท 4:24PM
Summary

I implemented two recent ideas for long-context inference / KV-cache compaction and open-sourced both reproductions: Cartridges: https://github.com/shreyansh26/cartridges STILL: https://github.com/shreyansh26/STILL-Towards-Infinite-Context-Windows The goal was to make the ideas easy to inspect and r

Continue reading the full article
Read at r/MachineLearning
www.reddit.com
Back to all stories