Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

Gemma 4 - 31b abliterated quants

Via r/LocalLlama
Thursday, Apr 2, 2026 · 10:49PM
Summary

Got inspired to try and crack this egg without using heretic. FP16, Q8_0 and Q4_K_M quants, plus the abliteration script for modification/use is here: https://huggingface.co/paperscarecrow/Gemma-4-31B-it-abliterated-gguf based off of mlabonne's Orthogonalized Representation Intervention method, beca

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories