And what are you using for kv cache and context? What kind of performance are you getting? What is your hardware? And what are you using your models for? I figure with how fast everything moves, its worth asking once in a while to congeal our experiences.
