I implemented two recent ideas for long-context inference / KV-cache compaction and open-sourced both reproductions: Cartridges: https://github.com/shreyansh26/cartridges STILL: https://github.com/shreyansh26/STILL-Towards-Infinite-Context-Windows The goal was to make the ideas easy to inspect and r