attn-rot (ggerganov's "TurboQuant lite") is on the cusp of getting merged into llama.cpp

gonna delete this as soon as it's merged, just couldn't contain my excitement. LOOK AT THAT BENCHIE: Qwen3.5-35B-A3B (master) fully in VRAM: KV quant mean KLD 99% KLD same top p q8_0 0.003778 ± 0.000058 0.035869 97.303 ± 0.042 q4_0 0.010338 ± 0.000085 0.078723 95.331 ± 0.055 type_k type_v test t/s b