Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

Gemma4 26B A4B NVFP4 GGUF

Via r/LocalLlama
Thursday, May 7, 2026 · 8:46PM
Summary

Hey everyone! I’ve just uploaded a GGUF version of nvidia/Gemma-4-26B-A4B-NVFP4. It is not currently possible to run it with the main branch of llama.cpp, so I’ve also made a Docker image for it. It’s available at catlilface/llama.cpp:gemma4_26b_nvfp4. Unfortunately, I don’t have any resources other

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories