Thought i would just add my own flags here for llama.cpp (literally pulled and rebuilt latest today). Running on a 4090 FE and 48gb of DDR4 ram on WSL2. Basically you have 3 knobs you can tune for maximum context. I prefer to keep my kv cache at `q8_0` maximum (though i am interested in comparing q6
