For anyone interested in building their own GGUF quants, I’ve put together the GGUF-Tool-Suite docs and a simple web UI to make the process easier. Docs: https://github.com/Thireus/GGUF-Tool-Suite/tree/main/docs Web UI: https://gguf.thireus.com/quant_assign.html The goal is to let anyone benchmark a
