Best AI News โ€” Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

Here is my llama.cpp NVFP4/MXFP6 GGUF quantizer tool

Via r/LocalLlama
Friday, Jun 5, 2026 ยท 4:10AM
Summary

Hello everyone I wanted to share what I've been working on. I started writing NVFP4 kernels for llama.cpp last year and needed the ability to quantize NVFP4 GGUFs, so this project started as an NVFP4 quantizer. It's since become much larger. I would love to get more help to improve it. This is what

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories